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AN  INVESTIGATION  INTO  THE  ELEMENTS  WHICH  CONSTITUTE  GOOD 
TEACHING  IN  THE  ELEMENTARY  SCHOOL 

INTRODUCTION 

Much  time  and  effort  have  been  expended  in  recent  years 
in  attempts  to  determine  the  factors  that  are  involved  in  teach- 
ing efficiency.    These  attempts  are  a  part  of  the  general  move- 
ment that  has  been  evident  for  some  time  in  commerce  and  the  in- 
dustries.   This  scientific  or  analytic  attitude  which  has  only 
recently  been  adopted  to  any  extent  in  the  field  of  education, 
has  taken  three  principal  forms.    In  some  instances  the  attempt 
has  been  made  to  measure  the  total  efficiency  of  the  teacher"*". 
Sometimes  the  stress  has  been  put  entirely  upon  the  worth  of  the 
teaching,  as  determined  by  observation  of  classroom  work*.  In 
still  other  instances  attempts  have  been  made  to  determine  the  re- 
sults of  the  teaching  upon  the  pupils,  by  means  of  objective  tests 

3 

in  particular  subjects  . 

The  present  study,  then,  is  not  an  approach  to  a  new 
problem,,  but  it  is  an  attempt  to  find  a  better  approach  to  an  old 
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problem.    It  is  an  attempt  to  determine  with  some  definiteness  the 
factors  which  constitute  good  teaching  in  the  elementary  school, 
and  to  ascertain,  as  far  as  possible,  the  relative  importance  of 
each  of  these  factors.    The  writer  has  not  attempted  to  make  a 
complete  analysis  of  the  teacher  and  an  evaluation  of  him  in  each 
of  his  activities  and  relations.    The  investigation  is  limited  to 
a  consideration  of  actual  classroom  work,  the  teaching  process. 

Four  principal  aims  have  been  kept  in  mind  thruout  the 
investigation:  First,  to  limit    the  number  of  items  to  be  consid- 
ered, in  order  not  to  make  the  list  cumbersome  and  discouraging 
to  persons  using  it,  and  at  the  same  time  to  make  each  of  these 
items  so  clear  that  it  will  have,  as  nearly  as  possible  the  same 
meaning  for  all  persons  using  the  list;  Second,  to  avoid  a  purely 
arbitrary  selection  and  evaluation  of  items;  Third,  to  get  as 
fair  an  estimate  as  possible  of  the  teaching  in  each  room  by  se- 
curing a  number  of  ratings;  and  Fourth,  to  secure  an  objective 
check  upon  the  ratings  by  ascertaining  the  progress  made  by 
pupils  in  some  of  the  elementary-school  subjects. 
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CHAPTER  I 

TEACHER-RATING  .FORMS 

A.  Importance  of  a  Teacher -Rating  Scale  from  the  Super- 
intendent's Point  of  View. —    One  conception  of  a  teacher-rating 
scale  is  that  of  a  measuring  device  which  a  superintendent  can 
apply  to  his  teachers  and  thereby  determine  in  any  particular 
case  whether  a  teacher  should  be  promoted  or  reduced  in  rank,  re- 
tained or  dismissed.    This  view  of  the  proper  use  of  a  scale,  ex- 
clusively by  the  superintendent,  accorded  well  with  earlier  con- 
ceptions of  the  function  of  a  superintendent.    The  superintendent 
was,  in  the  larger  school  systems, sometimes  an  organizer,  sometimes 
an  administrator,  sometimes,  and  still  too  often,  merely  a  clerk 
to  the  board.    In  the  smaller  school  systems  he  was  little  more 
than  one  of  the  teachers.    He  was  seldom  a  supervisor  of  teaching 
in  any  real  sense.    In  recent  years  the  duties  of  a  superintendent 
as  a  supervisor  of  teaching  have  come  to  be  recognized  as  among  his 
most  important  duties.    Whereas    the  duties  of  a  superintendent 
in  connection  with  his  teachers  were  formerly  concerned  largely 
with  recommendations  for  appointment  and  dismissal,  promotion  and 
reduction  in  rank,  they  are  today  largely  concerned  with  the  im- 
provement of  teachers  in  service. 

Corresponding  to,  tho  not  coincident  with,  this  new  and 
growing  opinion  of  the  importance  of  the  supervisory  duties  of 
the  superintendent  has  come  the  realization  of  an  added  purpose 
in  schemes  for  rating  teachers.    The  superintendent  must  have  a 
basis  for  making  recommendations  for  promotion  and  dismissal  of 
his  teachers,  and  to  provide  an  adequate  and  largely  objective 


-4 


basis  is  at  least  one  of  the  principal  functions  of  one  type  of 
scale.    There  should  be  a  scale,  however,  the  aim  of  which  is  to 
make  possible  more  thorough-going  cooperation  between  the  superin- 
tendent and  his  teachers  in  the  improvement  of  the  latter.  A 
scale  for  rating  teaching  efficiency  should  prevent  the  superin- 
tendent from  basing  his  judgment  of  a  teacher's  work  on  trivial 
matters,  on  non-essentials.    Without  some  clearly  formulated  list 
of  items,  such  as  a  scale  should  contain,  there  is  danger  that  a 
superintendent,  principal,  or  supervisor  will  be  too  largely  in- 
fluenced by  trivial  personal,  unimportant,  or  irrelevant  consider- 
ations. 

Again,  the  superintendent's  unanalyzed  judgment  may  be 
approximately  correct  and  yet  the  impression  of  the  superiority  or 
inferiority  of  the  teaching  may  be  so  hazy  and  indefinite  in  the 
superintendent's  mind  that  he  wilsl  be  unable  to  make  any  suggestions 
of  value.    Any  one  may  casually  visit  a  recitation  and  be  impressed 
at  the  close  with  the  feeling  that  it  was  satisfactory  or  unsatis- 
factory, without  being  able  to  point  out  definite  and  specific 
virtues  or  defects.    Upon  referring  his  observations  to  standards 
which  he  has  set  up  for  a  recitation  he  may  find  that  the  organiz- 
ation of  the  material  of  the  recitation  was  bad,  the  proper  stress 
on  relative  values  was  lacking,  the  teacher's  voice  was  high  and 
rasping,  or  the  habits  of  the  pupils  were  slovenly.    When  any 
such  defect  stands  out  prominently  in  a  recitation  the  observer 
is  in  a  position  to  make  definite  suggestions.    From  the  point  of 
view  of  the  superintendent,  then,  two  types  of  scales  are  valuable. 
The  scale  which  measures  the  total  efficiency  of  the  teacher, 
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while  it  should  be  freely  accessible  to  the  teacher,  in  order 
that  he  may  know  on  what  points  he  is  judged,  has  as  its  prin- 
cipal aim  the  provision  of  a  fair  and  adequate  basis  for  deter- 
mining the  teacher's  right  to  promotion  or  salary  increase.  On 
the  other  hand,  the  scale  which  provides  an  analysis  of  the  teach- 
ing alone  and  a  comparative  evaluation  of  the  elements  composing 
it,  aims  to  provide  the  superintendent  with  a  basis  for  helpful 
suggestions  to  his  teachers  and  for  making  provision  for  their  im- 
provement in  other  ways. 

B.    The  Importance  of  a  Teacher -Rat ins  Scale  from  the 
Teacher1 s  Point  of  View. —    By  means  of  a  scale  for  rating  teach- 
ing efficiency  then  a  superintendent  should  be  able  to  help  his 
teachers,  but  even  to  a  greater  extent,  perhaps,  the  teachers 
should  be  able  to  help  themselves.    If  a  superintendent  should 
have  a  definite  and  clearly  formulated  list  of  items  upon  which 
to  judge  the  worth  of  the  teaching  in  his  schools,  it  is  equally 
important,  if  not  very  much  more  important,  that  the  teacher 
should  have  an  aid  for  the  analysis  of  his  teaching.    If  the 
superintendent  needs  such  an  aid  in  framing  helpful  suggestions 
for  his  teachers,  even  more  does  the  teacher  need  such  an  aid 
to  help  him  toward  well  directed  self- improvement .    The  teacher 
may  be  complacent  with  regard  to  his  accomplishment  in  his 
teaching  or  he  may  be  dissatisfied  without  knowing  just  what 
particular  phase  of  his  work  is  at  fault.    For  such  teachers  a 
scale  for  teaching  efficiency  should  reveal  their  points  of 
strength  as  well  as  their  points  of  weakness. 

 —  — — — ....   
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A  scale  for  rating  teaching,  then,  can  be  of  the  high- 
est service  only  when  it  is  used  cooperatively  "by  teachers  and 
superintendents.    The  superintendents  or  supervisors  can  make 
their  visits  only  at  comparatively  long  intervals.    The  teacher 
can,  and  should,  keep  a  record  of  his  work  from  day  to  day.  Where 
the  teacher  is  not  consulted  or  advised  in  regard  to  his  work,  he 
is  likely  to  be  all  too  ready  to  attribute  the  low  estimate  of 
a  superintendent  to  some  personal  bias.    The  more  teachers  are 
helped  to  appreciate  the  basis  on  which  the  weakness  or  strength 
of  their  work  is  estimated,  the  more  ready  will  they  be  to  ac- 
knowledge their  weaknesses  and  endeavor  to  correct  them.  The 
more  they  are  able  to  see  the  justice  of  a  superintendents 
comments  and  criticisms,  the  better  will  they  be  able  to  apprec- 
iate and  to  follow  any  intelligent  suggestions  made  by  him. 
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CHAPTER  II. 

METHODS  IN  USE  AND  METHODS  RECOMMENDED  FOR  TESTING 
THE  ABILITY  OF  TEACHERS 

A.    Examinations  as  a  Method  of  Testing  the  Ability  of 
Teachers. —    As  stated  earlier,  it  is  absolutely  necessary,  for 
efficient  school  administration  and  supervision,  that  there 
should  be  in  use  some  scheme  of  rating  teachers  and  teaching, 
based  on  some  kind  of  objective  determination  and  evaluation  of 
the  elements  which  constitute  the  efficiency  of  the  teacher  and 
the  teaching  process,  respectively.    Teacher-rating  in  some  form 
is  found  in  every  school  system,  whether  the  rating  is  based  on 
any  definitely  formulated  list  of  items  or  not.    Some  of  the 
schemes  in  use  will  be  reviewed,  for  the  purpose  of  finding 
if  possible  what,  in  the  opinion  of  school  men,  are  the  important 
elements  in  the  efficiency  of  elementary-school  teachers,  what 
are  the  just  bases  for  appointment  and  promotion. 

Of  the  common  methods  which  are  supposed  to  test  to 
some  extent  the  efficiency  of  the  teacher  one  is  an  examination  given 
to  prospective  teachers.    The  certificating  examinations  are  us- 
ually uniform  in  the  smaller  school  systems  and  country  districts 
of  a  state,  while  in  the  larger  city  systems  there  is  much  more 
independence  and  variety.    These  examinations  test  the  knowledge 
of  the  candidate  in  certain  narrow  fields  but  give  no  reliable 
evidence  of  teaching  ability.    They  serve  to  eliminate  some,  who, 
on  the  basis  of  scholarship,  are  unprepared  for  teaching. 
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Another  test  of  the  teacher  is  the  so-called  promotional 
examination.    This  method  is  worth  something  as  a  means  of  stim- 
ulating the  teacher  to  continued  study.    It  acts  as  a  spur  to 
some  teachers  who  are  inclined  to  feel  that  when  they  have  once 
been  appointed  to  a  teaching  position  they  are  entitled  to  life 
tenure  with  no    responsibility  for  further  professional  growth. 
The  preponderance  of  opinion  of  superintendents  who  have  tried 
promotional  examinations  seems  to  be  in  favor  of  such  examina- 
tions as  a  means  of  keeping  their  teachers  professionally  inter- 
ested, where  the  work  for  which  credit  for  promotion  is  given  can 
be  carried  on  simultaneously  with  the  every-day  work  of  the 
teacher.    Where  study  at  some  distant  university  or  normal  school 
is  involved,  however,  the  direct  financial  gain  is  not  for  a  long 
time  sufficient  to  reimburse  the  teacher  for  the  necessary  invest- 
ment of  time  and  money.    Hence,  many  teachers  do  not  consider  the 
advantages  derived  from  such  work  commensurate  with  the  cost  in- 
volved. 

B.    Teacher -Rating  in  the  Small  Cities. —      While  the 
certificating  examination  is  the  common  basis  for  admitting  can- 
didates into  the  teaching  profession,  and  while  the  promotional 
examination  is  more  or  less  common  as  a  basis  for  advance  in 
rank  and  increase  in  salary,  the  principal  basis  for  rating  the  ef- 
ficiency of  a  teacher,  once  he  has  begun  to  teach,  is  the  judg- 
ment of  the  superintendent  or  of  some  other  supervisory  officer. 
The  following  reports  from  superintendents  of  small  cities  are 
thought  to  be  fairly  representative  of  practice  in  cities  of 


-9- 


this  size  thruout  the  country  . 

Aberdeen,  South  Dakota.-    "We  have  70  teachers,  and  our 
means  of  judging  them  is  by  visiting  their  classes  and  by 
the  results  they  obtain  in  advancing  the  pupils  under  them." 

Champaign,  Illinois.-    "Nothing  but  general  observation. 
Until  we  can  know  the  effect  on  the  lives  of  pupils,  we 
can  not  rate  the  efficiency  of  teachers  justly.    I  trust 
personal  judgment." 

Charlotte,  North  Carolina.-  "Teachers  are  promoted  accord- 
ing to  their  qualifications  and  fitness  for  the  better  posi- 
tion.   This  is  left  to  the  judgment  of  the  superintendent 
and  board." 

Easton,  Pennsylvania.-    "We  have  no  definite  plan  when 
rating  and  promoting  teachers  except  a  general  committee 
discussion  at  the  end  of  the  year." 

Enid,  Oklahoma.-    "There  are  so  many,  many  qualities 
which  enter  (into  teaching  efficiency)  that  our  system 
has  never  undertaken  to  classify  them.    We  take  each 
teacher  and  get  the  product  of  all  factors  in  her,  with- 
out reducing  her  to  a  mathematical  formula." 

Hamilton,  Ohio.-    "We  have  no  fixed  rule  or  schedule 
for  rating  teachers.    The  only  question  which  we  consider 
is  the  efficiency  of  her  work,  and  this  is  gauged  by  the 
superintendent  and  principals." 

Nashua,  New  Hampshire.-    "It  is  merely  a  question  of 
judgment  on  the  part  of  the  superintendent." 

In  these  reports  from  superintendents  there  appears 
to  be  practically  no  agreement  as  to  the  basis  for  judgment  of 
of  the  teacher's  efficiency.     In  one  thing  only  do  they  appar- 
ently agree,  and  that  is  in  the  absence  of  any  analysis  of  that 
on  which  judgment  is  based.    There  are  many  minor  differences. 


A.  C.  Boyce:    Methods  for  Measuring  Teachers1  Efficiency.  The 
Fourteenth  Yearbook  of  the  National  Society  for  the  Study 
of  Education,  pp.  14  and  15.     (The  few  reports  quoted  are 
selected  from  a  much  longer  list  contained  in  this  work  of 
Boyce.) 
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In  some  cases  the  experience  or  length  of  service  in  the  system 
automatically  governs  the  salary  of  the  teacher.    All  teachers 
who  are  allowed  to  retain  their  positions  are  allowed  each  year 
an  increase  of  salary.    The  most  definite  statement  in  regard  to 
the  basis  on  which  teachers  are  retained  is  wIf  good  enough".  A 
slightly  different  method  is  represented  where  "a  general  com- 
mittee discussion  at  the  end  of  the  year"  is  the  only  attempt  made 
at  rating  teachers.    Some  superintendents  are  not  in  sympathy 
with  any  attempt  at  analysis  of  the  teacher's  ability.    One  re- 
port especially  shows  such  an  attitude.    "There  are  so  many, 
many  qualities  which  enter  into  teaching  efficiency  that  our 
system  has  never  attempted  to  classify  them.    We  take  each  teacher 
and  get  the  product  of  all  factors  in  her,  without  reducing  her 
to  a  mathematical  formula."    This  is  the  kind  of  attitude  on  the 
part  of  the  superintendents  which  makes  it  difficult    to  put  into 
practice  any  scheme  of  teacher-rating  based  on  scientific  analysis. 
From  this  point  of  view,  any  attempt  to  define  so  personal  a 
thing  as  teaching  efficiency  seems  almost  sacrilegious. 

A  similar  attitude  is  shown  by  a  report  from  one  of  the 
large  cities,  which  appears  later  in  this  chapter.    In  this  case 
the  superintendent  states  that  he  has  no  rating  form  and  wishes 
nothing  so  mechanical. 

That  a  certain  amount  of  caution  should  be  exercised 
in  the  use  of  rating -forms  no  one  will  deny.    No  rating  form, 
probably,  will  ever  include  all  qualities  that  are  desirable  in 
a  teacher  in  just  the  right  combination.    There  is  a  certain 

— ~ 
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danger  that  we  shall  come  to  depend  too  much  upon  such  aids  to 
judgment.    The  same  objection  may  be  applied  to  the  use  of  all 
objective  tests  in  the  school  subjects.    No  one  should  contend 
that  these  scales  and  tests,  in  their  present  stage  of  develop- 
ment at  least,  measure  all  of  the  good  results  that  may  be 
gained  from  the  subject  measured.    But  we  may  use  them  profit- 
ably if  we  use  them  disoriminately  and  do  not  claim  too  much  for 
them  in  our  interpretation  of  the  results.    To  condemn  the  use  of 
such  instruments  as  we  have  because  they  are  not  perfect  or  com 
plete  is  surely  unwarrantable. 

We  may  reasonably  hope  to  determine  by  observation  cer- 
tain factors  which  are  found  in  good  recitations  and  to  use  our 
knowledge  of  these  factors,  so  determined,  in  estimating  the 
worth  of  later  recitations  and  in  discovering  just  where  partic- 
ular emphasis  is  needed.    One  who  always  objects  to  an  investi- 
gation of  his  methods,  whether  he  be  engaged  in  school  work  or 
in  some  other  occupation,  is  open  to  some  suspicion.     "Some  of 
us  have  glorified  in  the  fact  that  we  were  dealing  with  forces 
which  we  did  not  understand,  and  have  found  a  peculiar  consola- 
tion in  the  belief  that  they  never  could  be  understood"1.  There 


1W.  C.  Bagley:    The  Need  of  Standards  for  Measuring  Progress 
and  Results.    Report  of  the  Proceedings  of  the  N.  E.  A. 
1912. 
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is  a  certain  sense  of  security  which  accompanies  such  a  feeling 
of  communion  with  the  inscrutable  and  the  immeasurable,  but  there 
is  not  a  confident  assurance  of  accomplishment. 

Most  of  the  replies  state  that  the  judgment  of  the  sup- 
erintendent is  accepted  as  the  basis  of  promotion  or  retention  in 
the  system,  and  it  is  probable  that  this  judgment  is  the  basis  of 
the  other  schemes  reported  above  which  do  not  expressly  state  it 
to  be  so.    There  is  a  real  difference,  however,  in  the  case  of 
those  cities  where  a  teacher  is  estimated  on  the  basis  of  his 
"promotion-record".    Such  a  system  has  the  apparent  advantage 
of  objectivity,  if  only  the  tests  of  the  progress  of  the  pupils 
could  be  oomplete.    Obviously,  however,  when  teaching  efficiency 
is  measured  in  this  way,  and  "progress  of  the  pupils"  is  made 
synonymous  with  "promotion",  the  resulting  effect  upon  the 
teaching  may  be  decidedly  narrowing  and  undesirable  and  the 
effect  on  standards  of  promotion  might  conceivably  be  vicious. 

The  danger  in  making  the  promotion  of  pupils  the  sole, 
or  the  most  important,  basis  on  which  to  judge  teachers  is  a  very 
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real  one,  whether  examinations  are  required  of  all  or  not;  "but 
it  is  particularly  threatening  where  examinations  are  omitted  in 
the  case  of  those  pupils  who  attain  a  sufficiently  high  grade  on 
the  term  work^.    When  the  advancement  of  a  teacher  depends  upon 
his  promotion  of  pupils,  he  is  very  strongly  tempted  to  lower  his 
standard  of  work  and  thereby  raise  his  promotion  record. 

Of  course,  only  the  minimum  of  desirable  results  from 
any  study  can  be  fixed  or  set  up  as  standards.    When  examinations 
and  tests  play  a  prominent  part  in  the  school  work,  the  estimat- 
ing of  teaching  efficiency  on  the  basis  of  promotion  of  pupils 
•tends  to  narrow  the  aims  of  the  teacher  to  those  requirements. 
On  the  other  hand,  when  examinations  and  tests  play  an  insignifi- 
cant part,  the  more  purely  subjective  standards  of  the  teacher, 
under  the  influence  of  considerations  of  self-advancement,  will 
tend  to  be  still  less  stable. 


An  interesting  investigation  of  the  effect  of  the  exemption  sys- 
tem upon  high  school  grades  has  recently  been  reported.  (C.J. 
Anderson:  Is  the  Exemption  System  Worth  While.    School  and 
Society,  March  4,  1916.  Vol. II I.  PP  357-360) 
A  study  was  made  of  the  grades  in  a  high  school,  covering  a 
period  of  6  years;  the  two  years  before  the  introduction  of  the 
exemption  system,  the  two  years  during  which  it  was  in  opera- 
tion, and  the  two  years  just  after  it  was  discarded.  Coinci- 
dent with  the  introduction  of  the  exemption  system  there  ap- 
peared a  decided  increase  in  the  number  of  high  grades.  In 
English  the  number  of  pupils  graded  in  the  first  division 
(grades  of  93-100)  reached  57%  of  the  total,  while  in  nearly 
every  subject  the  curve  representing  the  distribution  of  grades 
was  sharply  skewed  to  the  left  (toward  the  high  grades).    In  the 
two  years  preceding  the  introduction  of  the  exemption  system  and 
the  two  years  following  its  abolition,  the  distribution  of 
grades  followed  much  more  closely  the  normal  curve  of  probabil- 
ity.   While  the  fact  that  there  were  relatively  few  grades  in 
the  group  ranking  second  from  the  top,  may  be  attributed  in  part 
to  the  especial      incentive  which  the  exemption  system  offers  to 
those  who  are  near  the  exemption  grade,  to  increase  their  ef- 
forts, it  probably  means  in  many  cases  that  the  teacher  is  in- 
clined to  favor  all  whose  work  approaches  the  minimum  required 
for  exemption. 
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One  sup er in ten dent  suggests,  as  others  have  done,  that 
"until  we  know  the  effect  on  the  lives  of  the  pupils, we  can  not 
rate  the  efficiency  of  teachers  justly".    Whether  an  investigation 
of  the  effect  on  the  lives  of  the  pupils  is  here  meant  to  be  ser- 
iously recommended  or  whether  this  statement  is  simply  an  expres- 
sion of  this  superintendent's  opinion  of  the  hopelessness  of  the 
task  of  determining  teaching  ability,  can  not  be  definitely 
stated.    The  aim  of  such  an  investigation  is  worthy,  but  the 
possibility  of  carrying  it  thru  seems  rather  remote. 

C,    Teacher  Rating;  in  the  Large  Cities . —    In  most  of 
the  larger  cities  a  more  or  less  detailed  analysis  of  the  abil- 
ity of  the  teacher  is  attempted  and  a  rating  in  a  list  of  items 
is  made  by  one  or  more  supervisory  officers. 

In  order  to  ascertain  exactly  the  method  of  rating 
teachers  in  the  large  cities  the  writer  directed  the  following 
letter  to  the  superintendents  in  all  of  the  thirty-two  cities  in 
this  country  with  a  population  of  more  than  one  hundred  fifty 
thousand^" . 

"Will  you  please  send  me  the  forms  that  you 
use  in  rating  elementary  school  teachers?    If  you 
use  no  printed  forms,  will  you  please  indicate  the 
general  plan  you  use  in  estimating  their  efficiency? 

"If  you  can  give  me  any  information  as  to  when 
and  where  definite  forms  for  rating  teachers  were 
first  used,  I  shall  be  very  grateful.    I  am  en- 
closing postage  and  shall  very  much  appreciate  an 
early  reply." 

Twenty-six  superintendents  responded  to  this  request. 
The  facts  for  two  of  the  remaining  six  cities  have  been  gathered 

^"On  basis  of  1910  census. 

—    ,       -  „  
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from  other  sources'1". 

Eleven  of  these  cities  use  no  rating  form.  These 
cities  still  depend  upon  the  general  estimate  of  the  superin- 
tendent, the  principal,  the  special  supervisor,  or  all  combined; 
supplemented  by  the  teacher's  record  with  regard  to  experience 
and  professional  preparation.    In  Chicago  much  stress  is  laid 
upon  the  teacher's  successful  experience,  while  in  Cincinnati 
a  great  deal  of  stress  is  laid  upon  his  preparation  and  contin- 
ued professional  interest  and  growth. 

The  rating-forms  used  in  the  seventeen  remaining  cities 
defy  accurate  classification.    Among  some  of  these  there  is  a 
wide  variation  in  the  emphasis  put  upon  the  various  phases  of 
teaching  ability,  and  consequently  in  the  items  included  in  the 
rating  form.    Egen  between  these  cities  which  agree  as  to  the 
importance  of  the  large  bases  of  teaching  ability,  there  is  little 
agreement  in  regard  to  the  extent  to  which  these  larger  factors 
shall  be  further  analyzed.    The  four  groups  below  represent  the 
classification  which  the  writer  has  made  in  order  to  facilitate 
a  further  discussion  of  these  forms: 


1See  Elliott:    City  School  Supervision,    pp  154-160  for  forms 
used  in  New  Orleans  and  Philadelphia. 
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Group  I 

Group  II              Group  III 

Group  IV 

Cities  using 
no  Rating  Form 

Cities  using       Cities  using        Cities  using 
Form  Made  Up       Form  Composed       Forms  consist- 
of  a  Few            of  a  long  list      ing  of  long 
Comprehen-         of  Unclassi-         Lists  of  classi- 
sive  Terms           fied  Items            fied  Items 

Baltimore 

Jersey  City 

Boston 

Chicago 

Kansas  City  Atlanta 

Cleveland 

Columbus 

New  York  Milwaukee 

3 

Detroit 

Buffalo* 

Oakland  Toledo 

Newark 

Cincinnati 

Philadelphia  (Minneapolis 

)         New  Orleans 

Indianapolis 

St.  Louis 

Providence 

Los  Angeles 

Rochester 

Portland 

Washington 

San  Francisco 

Seattle 

q+  pai1i 
o  0 •  raUx 

Superintendents  in  some  of  the  cities  in  Group  I  report 

certain  inclusive  qualities  which  they  try  to 

keep  consistently 

in  mind  in  forming  judgments  of  teachers,  but 

they  do  not  at- 

tempt  to  formulate  these  in  writing.    One  of  these  eleven  super- 

intendents expresses  his  regret  that  he  has  no 

rating  form. 

1 Atlanta  uses  a  form  containing  ten  rather  inclusive  terms.  She 
oan  be  more  justly  classed  with  group  III,  however,  than  with 
any  other  group. 

2No  form  for  regular  teachers.    Form  of  sixteen  items  for  substi- 
tute teachers. 
3Elliott  scale,  slightly  modified. 

4Form  received  late,  not  included  in  the  above  discussion. 

-17- 

Another  writes  very  emphatically  that  he  wishes  nothing  so 
mechanical.    The  other  nine  are  silent  on  this  point. 

The  following  form,  used  in  St.  Louis,  is  typioal  of 
the  forms  sent  in  from  cities  of  Group  II: 


Practical  Efficiency 


Management 
of  children 


Professional  Qual- 
ities 


Instruction 


Attention  to 
Details  of 
School  Busi- 
ness 


Scholar- :  Prof  es-  -.Personal 
ship    :sional  : Quall.fi- 
: Inter-  '.cations 
:est  and: 
:  Growth: 


Such  a  form  suggests  the  large  divisions  of  teaching 
ability.     It  leaves  to  the  person  rating    the  task  of  analyzing 
these  comprehensive  terms;    estimating  in  terms  of  the  itemized 
elements  of  each;  and  summing  up  the  results  in  the  form  of  rat- 
ings in  the  few  inclusive  terms.    The  alternative  to  this  method, 
for  the  person  using  a  form  of  this  sort,  is  to  depend  upon  a 
general  impression;  based  on  a  few  conditions  which,  experience 
has  taught  him,  stand  out  in  recitations  of  a  given  grade,  good 
or  bad.    In  exceptional  cases  this  may  be  a  trustworthy  method, 
but  the  writer  believes  that  such  a  scheme  in  general  use  is  far 
less  reliable  than  a  more  detailed  form. 
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Th*  form  used  in  Toledo  is  shown  below,  as  an  example  of  the  forms 
used  in  the  cities  of  Group  III: 

1.  Name  of  Teacher 

2,  Scholarship 

3«  Success  in  Teaching 

k.  Preparation  of  Lessons 

5*  Ability  to  hold  Attention  of  Class 

6.  Success  in  Discipline 

7.  Spirit  of  School 

8.  Care  of  Boom 

9.  Health 

10.  Personal  Appearance 

11*  Professional  Industry  and  Spirit 

12.  Self-Control 

13.  Attitude  toward  Children 

14.  Attitude  toward  Parents 

15.  Attitude  toward  other  Teachers 

16.  Does  the  Teacher  Cooperate  heartily  with  the  Principal? 

17.  Is  she  faithful?  —  Reliable?—  Progressive? —  Punctual? 

18.  Do  outside  duties  or  pleasures  render  this  Teacher  relatively  less 

efficient  in  her  school  work? 

19.  What  is  the  most  successful  feature  of  this  Teacher* s  Work? 

20.  The  weakest  feature? 

21.  How  many  times  has  this  Teacher  been  tardy  this  year?    How  many 

day 8  absent? 

22.  Approximately  how  many  times  have  you  visited  this  Teacher's  room 

during  the  present  year? 

23.  Do  you  recommend  that  this  Teacher  be  retained,  basing  your  answer 

solely  upon  the  question  of  efficiency? 

2^,  Remarks  
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It  is  unwise  to  criticise  a  rating  form  too  harshly 
when  the  results  attained  by  its  use  are  not  known.    However,  the 
Toledo  form,  representing  the  type  of  form  used  in  the  cities  of 
Group  IIJ, invites  adverse  criticism  from  several  points  of  view. 

This  form  shows  no  evidence  of  an  attempt  at  a  thoro- 
going  analysis  of  teaching  ability  or  any  consistency  in  the  ar- 
rangement of  the  items.    It  appears  to  be  little  more  than  an  at- 
tempt to  enumerate  as  many  as  possible  of  the  items  which  are  con- 
nected with  the  teacher1 s  efficiency,  with  no  indication  of  their 
relative  importance  or  of  their  inter-relationships.    All  of  the 
items  are  apparently  considered  coordinate.    There  is  also  much 
duplication  among  the  items.     "Ability  to  hold  Attention  of  Class" 
can  not  be  judged,  as  distinct  from  "Success  in  Discipline"  and 
"Control  of  Pupils";  neither  can  "Preparation  of  Lessons"  be 
separated  from  "Professional  Industry  and  Spirit";  while  "Success 
in  Teaching"  must,  at  least  partially,  include  many  of  the  other 
items . 

This  form  is  fairly  representative  of  early  attempts 
at  form-making.    It  represents  a  necessary  stage  in  the  development 
of     rating  forms,  but  this  stage  is  happily  passing  if  we  may 
judge  by  the  fact  that  very  few  of  the  important  cities  now  use 
forms  of  this  type. 
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The  following  form,  used  in  Cleveland,  represents  well  the  forms 
used  in  the  cities  of  Group  IV; 

1.  Teaching  Power 

a.  Does  she  apply  thought  and  method  to  the  preparation  of  her  daily 

work? 

b.  Is  she  definite  in  her  instruction?     Thoughtful  ? 

c.  Does  she  develop  power  in  her  pupils? 

d.  What  kind  of  results  does  she  obtain? 

2.  Executive  Power 

a.  Is  she  successful  in  discipline? 

b.  Does  she  secure  a  responsive  working  spirit  in  the  school? 

c.  Are  her  relations  with  the  principal's  office  satisfactory  in 

matters  of  reports,  care  of  property,  discipline  of  pupils,  etc. ? 

d.  What  are  her  relations  with  the  patrons  of  the  school? 

e.  What  are  her  strong  points? 

f.  What  are  her  weak  points? 

3*    Personal  Influence 


a.  Does  she  inspire  her  pupils  and  develop  in  them  enthusiasm  for  work? 

b.  Does  she  inspire  her  pupils  to  independence  in  work? 

c.  Does  she  influence  her  pupils  for  good  beyond  the  time  they  are 

in  her  presence? 

d.  Are  her  relations  with  other  teachers  in  the  building  wholesome? 

e.  Is  her  work  interfered  with  by  outside  pleasures  or  duties  or 

the  state  of  her  health? 

U.    Professional  Sincerity 


a.  Is  she  sincere  and  earnest  in  her  work? 

b.  Does  she  measure  thoughtfully  the  outcome  of  her  practice? 

c.  What  is  her  attitude  toward  the  large  interests  of  her  profession? 

d.  Is  she  frank  and  candid  in  her  dealings  with  pupils? 

e.  In  what  spirit  does  she  receive  the  suggestions  of  the  principal 

and  supervisors? 
Does  she  regard  them  as  personal  or  professional? 

5«    General  Culture 


a.  Are  her  scholarship  and  general  information  accurate  and  adequate? 

b.  Are  her  manner,  control  of  voice,  and  use  of  English  satisfactory? 

c.  Is  she  alert,  progressive,  and  open-minded  to  new  ideas? 
d*    What  are  her  special  interests? 

e.    Has  the  teacher's  personality  been  sufficiently  faulty  to  require 
serious  criticism? 
Have  you  made  such  criticism? 
How  often? 
With  what  effect? 


1111       11  — — -  '  " 
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While  the  position  of  a  number  of  the  items  might  be 
seriously  questioned,  this  form  shows  clearly  an  attempt  to  make 
a  real  analysis  of  the  ability  of  the  teacher.    Some  such  detailed 
itemized  form  for  rating  is  necessary  for  most  principals  and 
supervising  officers,  if  not  for  all.    The  superintendent  who 
has  analyzed  teaching  ability  and  satisfied  himself  as  to  the 
elements  constituting  it,  may  think  it  unnecessary  to  formulate 
his  scheme  in  writing.    This  is  probably  the  position  which  the 
advocates  of  the  St.  Louis  type  of  form  would  take.    Where  the 
actual  rating  and  supervision  must  be  left  to  other  persons,  how- 
ever, as  it  must  be  in  the  larger  cities,  a  form  containing  a 
rather  definite  and  detailed  list  of  items  is  very  necessary. 

The  new  rating  forms  just  prepared  for  use  %n  Boston 
almost  deserve  a  separate  classification.    The  Department  of  Educa- 
tional Investigation  and  Measurement,  under  the  direction  of 
Frank  W.  Ballou,  has  worked  out  the  most  elaborate  scheme  of 
teacher  rating  yet  devised  in  any  school  system.    Three  long 
forms  of  four  pages  each  are  used,  and  in  these  a  complete  analy- 
sis of  the  teacher1 s  total  efficiency  is  attempted.    One  form 
deals  at  length  with  the  teacher's  professional  preparation; 
another  with  his  continued  professional  growth,  as  evidenced  by 
educational  articles  or  books  written,  educational  literature 
read,  summer  schools  attended,  etc.    The  third  form  is  made  up 
of  two  general  topics:  Personal  Equipment,  and  Ability  as  a 
Teacher.    Personal  Equipment  includes  personal  characteristics 
under  nine  sub-topics.    Teaching  Ability  includes  Management  of 
the  Room,  Management  of  the  Class,  and  Teaching  the  Lesson.  Eight- 
een items  are  subsumed  under  these  last  three  sub-topics. 
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These  forms  are  too  bulky  to  be  included  in  this  study, 
but  the  foregoing  description  will  give  some  idea  of  the  elabor- 
ate forms  which  are  being  devised  in  the  more  progressive  cities. 

The  earliest  use  of  a  printed  form  for  rating  teachers, 
which  could  be  traced,  was  in  Milwaukee  in  1896.    Other  cities 
began  the  use  of  such  forms  as  early  as  1900. 

The  situation  in  regard  to  teacher -rating  in  the  larger 
cities  is  encouraging,  at  least  in  so  far  as  the  scale  for  the 
total  efficiency  of  the  teacher  is  concerned.    While  nothing  ap- 
proaching a  common  agreement  as  to  the  elements  which  constitute 
efficiency  in  the  teacher,  and  far  less  agreement  as  to  the  com- 
parative value  of  each,  has  been  reached;  there  is  a  great  deal 
of  experimentation  in  progress,  which  should  lead  in  time  to  a 
solution  of  the  problem.    In  the  smaller  cities  the  situation  is 
not  nearly  so  encouraging.    In  so  far  as  the  available  facts  con- 
cerning these  cities  are  representative  of  conditions  generally 
in  this  type  of  city  (and  there  seems  to  be  little  reason  to  doubt 
that  they  are  fairly  typical)  the  use  of  any  kind  of  itemized  list 
of  qualities  as  an  aid  to  an  analyzed  estimate  of  the  teacher  or 
of  teaching  efficiency  is  exceedingly  rare. 

D.    Teacher  Rating  Scales  Proposed  for  General  Use.  

Besides  the  numerous  teacher  rating  scales  constructed  for  use  in 
particular  cities,  two  scales  have  been  published  which  have  been 
intended  for  general  use.    The  work  of  A.  0.  Boyce,  to  be  de- 
scribed later  under  the  head  of  Investigations  of  Qualities  of 
Merit  and  the  Causes  of  Failure  Among  Teachers,  finally  resulted 
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in  a  scale;  "but  that  study  can  be  more  appropriately  included 
under  the  latter  heading,  inasmuch  as  it  involved  an  experimental 
investigation  of  Qualities  of  Merit,  and  its  primary  object  was 
not  the  construction  of  a  scale.    The  two  scales  considered  here, 
then,  are  those  of  Elliott  and  Witham. 

The  earlier  of  these  scales  was  prepared  by  Professor 
E.  C.  Elliott  in  19101.    This  scale  comprises  eight  large  topics, 
and  under  these  are  included  forty- two  subtopics.    Each  one  of 
the  qualities  is  given  an  arbitrary  value  on  the  scale,  and  the 
grade  of  a  teacher  can  be  read  off  on  the  basis  of  a  perfect  score 
of  1000.    Suggestions  are  made  as  to  how  and  on  what  basis  de- 
ductions from  the  perfect  score  are  to  be  made. 

A  very  recent  teacher  rating-scale  is  that  devised  by 
Superintendent  E.  C.  Witham*.    This  "Measuring  Scale  for  Teacher 
Measurement"  embraces  forty-six  items.    It  is  comprehensive,  but 
also  somewhat  cumbersome.    The  method  of  scoring  is  unique.  Witham 
provides  three  grades  (+,  a,  and  -)  for  each  of  the  items,  and 
attempts  an  exact  definition  of  what  is  deserving  of  each  score. 
In  endeavoring  to  fix  these  points  so  clearly  as  to  avoid  any 
misunderstanding  of  them  by  any  one  using  the  scale,  he  often 
makes  definitions  for  degrees  of  merit  which  are  hopelessly 
artificial.    For  instance,  under  the  item,  Travel,  he  prescribes 

1E.  C.  Elliott:    A  Tentative  Scale  for  the  Measurement  of  Teach- 
ing Efficiency.  University  of  Wis- 
consin, 1910.    Slightly  modified  1914.    See  Appendix  for 
scale . 

2Teachersf  Yearbook  of  Educational  Publication.    1915.  Pub.  No.  6. 
pp.  54-58.     See  Appendix  for  scale. 
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th  e  following  definitions  of  the  scores: 

Over  1000     miles  from  place  of  birth  + 

500  tow  "  Bnitna 

Less  than  500  "         «        «        n      «  _ 

E.    Investigations  of  the  Qualities  of  Merit  and  the 
Causes  of  Failure  Among  Teachers. —    In  1910  Ruediger  and 
Strayer    published  an  account  of  an  investigation  into  the  qual- 
ities of  merit  in  elementary  teachers. 

They  chose  ten  items  or  qualities  which  they  judged  to 
be  important  factors  in  the  efficiency  of  a  teacher.    They  had 
superintendents  and  principals  rank  their  teachers  (204  teachers) 
in  each  of  these  ten  items  and  in  General  Merit.    From  these 
rankings,  correlations  between  General  Merit  and  each  of  the  ten 
qualities  were  determined,  and  conclusions  were  drawn  as  to  the 
relative  importance  of  each  of  the  qualities  in  the  total  effic- 
iency of  the  teacher. 

The  authors  stated  that  their  scheme  was  merely  tenta- 
tive, and  did  not  maintain  that  it  was  by  any  means  complete. 

In  a  study  similar  to  the  one  outlined  above,  A.  C. 
Boyce2  in  1912  endeavored  to  determine  the  inter-relationships 
of  qualities  of  merit  in  high  school  teachers  and  the  correla- 
tions of  each  with  general  merit.    He  borrowed  from  Elliott's 
scale  the  general  headings:  Administrative,  Dynamic,  Achievement, 
Social  Spirit,  Physical, and  Moral.    Boyce's  list  of  qualities  is 

1 Journal  of  Educational  Psychology,  May,  1910.  Vol.  I,  pp. 272-278. 
2Journal  of  Educational  Psychology,  May,  1912.  Vol.3,  pp.  144-158 
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longer  than  that  of  Ruediger  and  Strayer,  but  the  type  of  qual- 
ities included  is  not  markedly  different.    In  general  aim,  too, 
the  scale  agrees  with  the  earlier  one.    It  represents  an  attempt 
to  determine  the  relative  importance  of  each  of  the  qualities 
entering  into  the  total  efficiency  of  the  teacher. 

Boyce1 s  method  in  his  investigation  was  similar  to  that 
of  Ruediger  and  Strayer.    He  had  superintendents  simply  rank 
their  teachers  in  each  of  the  qualities  of  his  list.    The  super- 
intendents then  ranked  the  same  teachers  in "general  merit?  Cor- 
relations between  each  of  the  qualities  and  "general  meritnwere 
then  worked  out,  as  in  the  study  of  Ruediger  and  Strayer,  these 
correlations  being  used  in  this  study,  as  in  theirs,  as  a  basis 
for  certain  conclusions  as  to  the  relative  importance  of  the 
qualities  as  factors  in  determining  the  efficiency  of  teachers. 

In  a  later  and  much  more  detailed  study  in  the  same 
field,  Boyce  has  had  his  scale,  now  analyzed  and  amplified  to 
include  45  items,  applied  to  424  teachers  in  33  cities1.  These 
teachers  were  rated  in  twenty  school  systems  by  the  superinten- 
dents and  in  the  remaining  nineteen  by  the  high  school  princi- 
pals.   In  this  later  study  Boyce  has  provided  for  the  distribu- 
tion of  teachers  by  rank  in  accordance  with  the  theory  of  the 
curve  of  probability.    He  has  chosen  for  convenience  the  distri- 
but ion  recommended  by  Cattell  : 

Very  Poor         Poor         Medium  Good  Excellent 

10  20  40  20  10 

Thus,  there  are  ten  vertical  columns  opposite  the  list  of  qyal»- 
U.  U.  Boyce:  Methods  Measuring  Teacher's  Efficiency,    xne  goufc- 
teenth  Yearbook  of  the  National  Society  for  J^e  Study  of  Educa- 
tion. Part  II.  The  University  of  Chicago  frr ess . Chicago , Illinois 
3J.  McKeen  Cattell:  Examinations,  Grades,  ana  Credits.  Popular 
Science  Monthly.    Vol.  LXVI,  p.  367. 
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itiee;  one  column  being  allowed  for  the  very  poor  teachers,  two 
for  the  poor,  four  for  the  medium,  two  for  the  good,  and  one  for 
the  excellent.    Some  such  required  distribution  is  more  or  less 
necessary,  as  many  superintendents  ^h  en  asked  to  distribute  their 
teachers  under  the  five  such  headings  as  those  used  in  the  above 
distribution,  tend  to  rank  all  of  them  high.    In  other  words, 
superintendents  do  not,  as  a  rule,  recognize  the  fact  that  the 
typical  teacher  is  the  mediocre  teacher.    This  is,  of  course, 
the  teacher  for    whom  rating  schemes  and  scales  are  primarily 
devised.    If  teachers  in  general  really  possessed  such  teaching 
ability  as  the  average  superintendent,  in  his  independent  judg- 
ment is  inclined  to  attribute  to  hie  teachers,  there  would  be 
much  less  need  for  a  rating  scale  of  any  sort  than  there  is  at 
present. 

The  results  of  the  studies  of  Ruediger  and  Strayer, 
and  Boyce  may  be  profitably  compared  with  the  results  of  three 
other  studies  which  were  directed  toward  a  determination  of  those 
qualities,  the  absence  of  which  in  teachers  is  most  often  re- 
sponsible for  failure. 

The  study  of  Miss  Moses  is  based  on  the  reports  of 
failures  of  high  school  teachers  and  the  causes  of  such  fail- 
ures, from  the  superintendents  in  seventy-six  school  systems^. 
The  other  study,  by  Sherman  Littler,  is  a  study  of  the  causes  of 
failure  among  elementary  teachers  .    Except  in  the  grade  of 
teachers  investigated,  it  is  similar  to  the  study  of  Miss  Moses. 

^School  and  Home  Education,  March,  1914. 
2School  and  Home  Education,  January,  1914. 
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In  the  two  lists  below,  the  left-hand  column  contains 
the  qualities  which  Ruediger  and  Strayer  concluded  to  be  the  most 
important  factors  in  teacher-efficiency,  in  the  order  of  their 
importance.    The  right-hand  column  contains  the  qualities  which 
Littler1 s  reports  indicated  were  responsible  for  failures  of 
elementary  school  teachers,  in  the  order  of  their  frequency  of 
occurrence. 

Ruediger  and  Strayer  Sherman  Littler 


1. 

Discipline 

1. 

Poor  Discipline 

2. 

Teaching  Skill 

2. 

Weak  Personality 

3. 

Initiative 

3. 

Lack  of  Teaching  Skill 

4. 

Personality 

4. 

Lack  of  Interest 

5. 

Studiousness 

5. 

Lazy-No  Daily  It eparat ion 

6. 

Following  Suggestions 

6. 

Failure  to  Cooperate 

A  similar  comparison  of  the  two  studies  applied  to  high-school 
teachers  shows  there  too  a  remarkable  agreement  as  to  the  impor- 
tance of  a  number  of  items  which  appear  in  both  lists  of  qualities, 
tho  the  similarity  of  results  is  not  so  striking  as  in  the  case 
of  the  elementary  school  studies. 


Boyce 

Miss  Moses 

1. 

Instructional  Skill 

1. 

Poor  Instruction 

2. 

Success  of  Pupils 

2. 

Weak  Personality 

3, 

Stimulation  of  Indi- 

3. 

Lack  of  Interest  in  the  Work 

viduals 

4. 

Intellectual  Capacity 

4. 

Weakness  in  Discipline 

5. 

Governmental  skill 

5. 

Lack  of  Sympathy 

6. 

Cooperation 

6. 

Inability  to  cooperate 

7. 

Studiousness 

7. 

Unprofessional  attitude 

8. 

Interest  in  the  Life  of 

8. 

Weakness  in  knowledge  of 

the  School 

Subject-matter 

9. 

Initiative 

9. 

Disloyalty 

10. 

Executive  Capacity 

10. 

Immorality 

11. 

Health 

11. 

Health 
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Th  e'  following  summarizes  the  results  of  a  more  recent 
study1  of  the  causes  of  failure  among  elementary  and  high  school 
teachers  combined,  the  items  being  ranked  here,  as  before,  in  the 
order  of  frequency  in  which  they  are  reported  to  appear  as  causes 
of  failure.    The  study  is  based  on  the  replies  from  116  superin- 
tendents, these  replies  dealing  with  the  causes  of  270  failures 
of  teachers  in  one  year  out  of  a  total  of  4848  teachers  considered. 

1.  Weakness  in  Discipline  8.  Too  Nervous 

2.  Lacked  Judgment  9.  Deficient  in  Social  Qualities 

3.  Poor  Methods  10.  Unprofessional  Attitudes 

4.  Deficient  in  Scholarship      11.  Unattractive  Appearance 

5.  Daily  Preparation  Insuf-      IS.  Lacked  Culture  and  Refine- 

ficient"  ment 

6.  Lacked  Sympathy  13.  Uninterested  in  Work  of  Teaching 

7.  Lacked  Industry  14.  Poor  Health** 

The  agreement  here  with  the  results  of  former  studies 
is  not  so  close  as  between  the  earlier  ones  just  compared,  unless 
we  put  an  extremely  liberal  interpretation  upon  some  of  the  items, 
as  the  author  suggests.    He  says  that  personality  can  not  be  di- 
vorced from  Disciplinary  Power,  hence,  include  it  under  the  head 
of  Discipline.    He  suggests  that  Sympathy,  Social  Qualities,  and 
several  others  might  come  under  the  same  head.    Under  Judgment 
he  would  consider  no  fewer  than  thirteen  of  the  other  items  that 
appear  in  his  list.    Many  of  the  items  are  not  directly  compar- 
able with  those  of  the  other  lists.    It  is  applied  to  high  school 
and  elementary  pupils  alike.    It  agrees  very  decidedly  with  the 
other  studies  in  indicating  the  importance  of  discipline.  Whereas 


^Henry  Buellesf ield:  Causes  of  Failure  Among  Teachers.  Educa- 
tional Administration  and  Supervision,  September,  1915. 
2A1 together,  27  causes  of  failure  were  reported  in  this  study. 
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former  studies  have  agreed  as  to  the  comparative  insignificance 

of  health  to  the  efficiency  of  the  teacher,  the  ranking  here 
places  it  near  the  middle  of  the  list.    This  fact  does  not  nec- 
essarily mean  that  the  results  of  this  study  are  opposed  to  the 
results  of  the  earlier  studies,  however,  as  many  more  qualities 
are  included  here. 

The  five  studies  compared  represent  what  might  be 
called  positive  and  negative  methods  of  working  toward  the  so- 
lution of  the  same  problem.    They  seem  to  show  that  superin- 
tendents have  unconsciously  reached  some  measure  of  agreement 
as  to  a  few  of  the  important  general  qualities  (however  ill-de- 
fined) which  enter  into  the  efficiency  of  teachers. 
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CHAPTER  III. 

A-    A  Survey  of  the  Field  of  Scales  and  Teste  in  Ele- 
mentary School  Sub.j ects. —    Inasmuch  as  the  writer  was  forced  to 
limit  his  testing  to  two  elementary  school  subjects,  he  wished  to 
select  two  which  had  been  well  recognized  and  standardized  and 
extensively  used.     In  order  to  make  an  intelligent  choice  it  was 
necessary  to  make  a  careful  study  of  the  scales  and  tests  which 
have  been  devised  and  a  survey  of  the  critical  literature.  The 
results  of  this  study  in  the  field  of  teste  and  scales  is  presented 
in  this  chapter  in  brief  tabular  form. 

The  tables  are  self-explanatory.     They  present  simply 
those  facts  which  are  essential  to  an  understanding  of  the  nature 
of  the  tests  which  have  been  devised,  of  the  extent  of  the  movement 
toward  objective  measurement  in  school  work,  and  to  a  comprehen- 
sion of  present  tendencies  in  the  formulation  of  such  tests.  Much 
time  and  space  could  be  profitably  devoted  to  a  thoroughgoing 
analysis,  comparison,  and  evaluation  of  the  methods  employed.  Only 
a  summary  treatment  of  this  sort  can  be  included  here. 

The  earliest  recorded  attempts  at  anything  approaching 
systematic  testing  on  a  comprehensive  scale  in  the  elementary 
school  subjects  were  begun  by  J.  M.  Rice1 in  1895.    He  did  not  do 
preliminary  testing  as  a  basis  for  a  scientific  investigation, 
and  his  conditions  were  by  no  means  uniform.     Some  years  later 
0.  P.  Cornman2,  and  still  later  C.  W.  Stone3,  improved  very  much 
the  methods  of  this  earlier  investigation  in  arithmetic.  It 

1  Educa^^n^^PTslarchl     A~Test  in  Arithmetic.  T¥e~Forum7Vol .  XXX IV, 

2Sp|fling  in  the  Elementary  School.  Poston.  190S.  Sinn  and  Co. 
SColumbia  Contributions  to  Education,  No.  19.  1908.  ______ 
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remained  for  S.  A.  Courtis4  to  extend  the  work  of  Stone,  apply 
tests  on  an  extensive  scale,  and  set  up  standards  of  achievements 
for  each  grade.     Rice's  name  deserves  a  prominent  place  in  the  list 
of  investigators  in  this  field,  not  for  the  practical  value  of 
his  immediate  results,  but  for  his  success  in  stimulating  further 
investigations. 

The  investigations  in  this  field  of  objective  measurement 
in  the  elementary -school  subjects  can  be  roughly  classified  into 
non-analytic  and  analytic.     In  the  first  type  of  study,  and  this 
is  the  general  type  of  most  of  the  earlier  studies,  the  educational 
product  has  been  taken  in  the  rough,  and  little  attempt  has  been 
made  to  discover  the  particular  points  of  strength  or  weakness. 
The  handwriting  scale  of  Thorndike  and  the  composition  scale  of 
Hillegas  represent  well  this  type.    As  contrasted  with  these  in  the 
same  subjects,  the  handwriting  scales  of  Houston,  Freeman,  and 
Gray  and  the  Harvard-Newton  composition  scale  represent  very  clear- 
ly the  analytic  type  of  scale. 

In  the  construction  of  scales  of  the  first  type  the  au- 
thors used  the  judgments  of  a  large  number  of  people,  as  to  the 
general  merit  of  the  specimens.     No  attempt  was  made  to  determine 
the  particular  merits  or  defects  of  any  sample  of  handwriting  or 
composition.    Many  of  the  judges  were  selected  because  of  their 
special  qualifications  for  judging  in  these  fields,  but  their 
judgment  represented  only  their  general  impressions.  Thorndike 
did  not  contend  at  the  time  of  his  investigation  that  this  method 


Elementary  School  Teacher.     Vol.  10,  Pp.  59-74  and  179-199. 
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should  be  finally  accepted.     He  simply  maintained  that  it  was  the 
best  method  known  at  that  time ..considering  the  uncertainty  as  to 
what  were  the  elements  of  importance  in  handwriting.     He  predicted 
that  an  analytic  scale  of  some  sort  would  come  into  use  when  the 
elements  constituting  what  is  called  "general  metit"  should  have 
been  determined.     The  Hillegas  composition  scale  was  constructed 
by  a  method  similar  to  that  used  by  Thorndike,  i.e.,  on  the  basis 
of  a  number  of  judgments  as  to  the  general  merit  of  samples.  No 
distinctions  were  made  among  the  various  forms  of  composition. 

The  Harvard-Newton  composition  scale  was  derived  after 
a  critical  study  of  a  comparatively  small  number  of  compositions 
of  each  of  the  four  prose  forms:  exposition,  description,  narra- 
tion and  argumentation.     The  specimens  were  taken  from  the  seventh 
and  eighth  grades  of  the  Newton  schools  and  were  carefully  criti- 
cised and  analyzed  by  the  principals  and  the  seventh  and  eighth 
grade  teachers  of  English.     Each  sample  which  appears  on  the  scale 
is  accompanied  by  a  critical  evaluation  and  justification  of  its 
position  in  relation  to  the  sample  just  preceding  and  just  fol- 
lowing.    Here  the  plan  was  to  have  from  a  few  judges  a  very  ex- 
haustive study  of  a  limited  number  of  specimens,  rather  than  the 
general  estimate  of  a  large  number  of  judges  on  a  great  many 
samples.     The  method  is  intensive  rather  than  extensive. 

The  handwriting  scales  of  Freeman  and  Gray  were  derived 
by  methods  similar  in  general  to  those  used  in  the  composition 
scale  just  described.    Both  of  these  authors  analyzed  specimens 
of  handwriting,  with  the  help  of  other  persons;  and  chose  certain 
qu^ities,   such  as  alignment,   spacing  of  words  and  letters,  slant, 
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etc,  which  were  found  to  determine  the  excellence  of  handwriting. 
Freeman  includes  five  such  elements  and  Gray  includes  nine. 

The  Courtis  teste  in  arithmetic  in  their  evolution, 
from  the  unanalytic  to  the  analytic  type,  might  be  cited  as  further 
evidence  of  the  development  of  tests  and  scales;  in  that  they 
have  come  to  recognize  particular,  rather  then  general,  arithmetical 
abilities.     The  two  types,  however,  can  be  distinguished  in  the 
following  tables. 

The  recent  developments  promise  to  transform  scales  and 
tests  from  mere  measuring  devices  into  supervisory  aids.     It  is 
worth  something  to  be  able  to  say  with  approximate  accuracy  what 
the  accomplishment  of  a  given  grade  in  handwriting  is,  as  compared 
with  a  large  number  of  similar  grades,  or  how  the  handwriting  of  an 
individual  compares  with  the  average  of  a  large  number  of  individ- 
uals of  his  grade.     This  is  the  most  that  the  advocates  of  the 
nonanalytic  type  of  scale  can  expect  to  accomplish  with  it.  A 
scale  or  test  would  be  worth  incalculably  more  if  by  means  of  it 
one  could  tell  just  wherein  a  sample  of  handwriting  or  other 
material  is  strong  and  wherein  it  is  weak,  and  on  the  basis  of 
this  analysis  point  out  just  where  the  emphasis  toward  correction 
or  improvement  in  any  particular  case  should  be  put.     Such  is 
the  goal,  the  reasonably  attainable  goal, toward  which  investigators 
in  this  field  are  striving. 
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Survey  of  Objective  Tests  and  Scales  in  Elementary  School  Subjects. 


Name  of 
Investi- 
gator 

Pice1 


Subject 
Investi- 
gated 


Date  of 
Study 


Arithmetic  1895 


General  Method  Employed 


Results 


Eight  examples  given  to     No  standard 
each  grade  (LV-vm)  inc.  of  achi eve- 
including  6000  pupils.        ment  estab- 
Measurement  of  general       lished  and 
arithmetical  ability.         no  tests  re- 
commended as 
standards. 


Stone2        Arithmetic  1908 


Courtis3  Arithmetic 


1909 
1918 
1914 


Measurement  of  specific 
arithmetical  abilities. 
Tests  in  addition,  sub- 
traction, multiplica- 
tion and  division.  Cor- 


Tests  in  the 
four  funda- 
mental arith- 
metical o- 
perations 


relation  between  different  and  in  sim- 


abilities  determined. 
Conditions  much  better 
controlled  than  in  Rice's 
tests  in  the  same  sub- 
ject.    6C00  papers  scored 
Sample  individual  scores 
and  median  scores  of  26 
school  systems  given. 


pie  reason- 
ing. 


Tests  in  copying  figures, 
in  the  four  fundamental 
operations  of  arithmetic, 
and  in  arithmetical  rea- 
soning given  to  large  num 
bers  of  pupils  in  early 
tests.     Later,  results 
modified  or  verified  by 
submitting  the  tests  to 
33000  pupils  in  the  New 
York  City  schools.  Stne 
tests  first  used  (1909). 
Tentative  tests  and 
standards  (1918).  Lat- 
est standards  (1914). 


Tests  and 
standard 
scores  work- 
ed out  for 

-each  grade 
on  the  basis 
of  scores 
made  by  pu- 
pils in  this 
investiga- 
tion. Score 
which  30^ 
equal  or  ex- 
ceed taken 
as  the  stan- 
dard. 


Educational  Research.     A  Test  in  Arithmetic.  The  Forum,  Vol. XXXIV. 
Pp.  331-297. 

° Arithmetical  Abilities  and  Some  Factors  Determining  Them.  Columbia 
Contlbutions  to  Education,  Teachers  College  Series.     No. 19, 1908. 
3Measurement  of  Growth  and  EffloiCTgy_in^rjJ^bangno.     El.  School 


Thorndikel  Drawing-  1913 


Hillegas2  English  1912 
Composition 


Eallou3      English  1913 
Composition 
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268  ratings  of  fifteen 
samples  of  drawing  made 
on  a  soale  of  0-17. 
Samples  then  arranged 
on  the  scale  in  accor- 
dance with  the  theory 
that  equally  often  no- 
ticed differences  are 
equal. 


Seven  thousand  composi- 
tions "by  "young  people" 
divided  roughly  into  ten 
classes,  representing  as 
many  grades  of  merit. 
83  samples,  covering  the 
whole  range,  with  some 
artificial  samples  to 
fill  the  gaps, rated  by 
a  number  of  judges  in 
degree  of  merit,  repre- 
sented numerically  and 
in  simple  relative  rank. 
Combined  judgments  used 
in  construction  of  scale. 
All  forms  of  composition 
used  indiscriminately  in 
the  scale. 


Eighth  grade  compositions 
from  the  Newton  schools 
used; twenty-five  samples 
of  each  form  of  composi- 
tion (narrative,  de- 
scription, exposition 
and  argumentation)  rated 
on  per  cent  basis,  with 
40  and  90  as  limits.  All 
samples  then  ranked  as  to 
relative  position.  All 
samples  showing  extremes 
in  rank  and  grade  elimi- 
nated.    Samples  chosen 
for  the  scale  which  ap- 
proximated grades  45,  55, 
65,   75,  85  and  95  most 
closely  and  showed  little 


Scale  of  frac- 
tional val- 
ues of  14 
steps,  ran- 
ging from  0 
to  17, 
with  a  sam- 
ple accom- 
panying each 
step. 


A  scale  con- 
taining sam- 
ples rang- 
ing in  merit 
from  0  to 
937. 


Six  point 
scale,  rang- 
ing from  40 
to  90,  each 
step  in  the 
scale  in- 
cluding a 
sample  of 
each  of  the 
four  forms 
of  prose 
composition. 


(Cart)Teacher.  Vol.  10,  Pp.  59-74  and  179-199. 
Measurement  of  Growth  and  Efficiency  in  Arithmetic. 


El. School  Tea- 


OA  cher,.  Vol.  11,,  Pp.  .171-185,  360-370  and  528-539.  ,  ^  nor,  0„„ 
.Standard  Scores  In  Arithmetic'.  El.  School  Teacher,  Vol.  12,  Pp.  127-237 
jjfontiimea  on  next  _pfrgg_) 


-36- 


variation  in  rankings. 
Each  sample  of  each 
form  of  composition 
analyzed  separately. 


Courtis1    English         1915       Large  number  of  pupils'  Standard 

Composition  compositions  rated  on         scores  on 

the  Hillegas  scale.  the  Hillegas 


scale  for 
Grades  IV- 
VIII. 


Thorndike2  Handwriting  1910 


One  thousand  samples  of 
(IV  to  VIII)  grade  chil- 
dren's handwriting  rat- 
ed in  general  merit  on 
a  scale  of  fourteen 
equal  steps,  and  this 
method  checked  by  rat- 
ing simply  according 
to  relative  merit. 


A  scale  con- 
sisting of 
fourteen 
equal  steps, 


Ayres3        Handwriting  1913       Measurement  of  a  particu-  Scale  of  8 

lar  quality  of  handwrit-  equal  steps 
ing,  legibility.     Large  (20-90). Sam- 
number  of  samples  rated  pie  repre- 
on  the  basis  of  the  senting  each 
time  required  to  read  step  attac 
them. 


(Cont. ) 

iThe  Measurement  of  Achievement  in  Drawing.     Teachers  College  Record. 
Mch.  1913. 

2The  Measurement  of  Quality  in  Eng.  Composition.     Teachers  College 

Record.     Sept.  1913. 
3Scales  for  the  Measurement  of  Eng.  Composition.     Harvard- Newt on 

Bulletin,  No.  11.     Harvard  University  Press,  Cambridge,  Mass. 


-Standards  in  Rates  of  Reading.     14th  Yearbook  of  the  National 

Society  for  the  Study  of  Education.  Pp.  44-59. 
2Handwriting.    Teachers  College  Record,  Mch.  1910. 

3A  Scale  for  the  Quality  of  Handwriting  of  School  Children.  Bulletin 
of  the  Division  of  Education  of  the  Russell  Sage  Foundation,  1912. 
Nc.  113. 
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Houston1    Handwriting  1918 


Starch3      Handwriting  1913 


Freeman3    Handwriting  1914 


Specimens  of  handwriting 
given  definite  value  and 
position  on  a  scale,  on 
the  basis  of  size,  form, 
smoothneas,   slant  and 
spacing  of  letters,  neat- 
ness or  marking  over 
of  letters  or  words,  and 
spacing  of  words. 


Samples  of  children's 
handwriting  rated  for 
their  legibility,  taking 
the  time  required  to 
read  an  exposed  section 
of  a  line,  thus  avoid- 
ing aid  from  the  con- 
text. 


Five  qualities  of  hand- 
writing selected;  uni- 
formity of  alignment, 
uniformity  of  slant, 
form  of  letters,  spac- 
ing of  words, and  spac- 
ing of  letters.  Sam- 
ples representing 
three  degrees  of  ex- 
cellence in  each  qual- 
ity chosen.    Wues  given 
to  these  samples  in 
each  quality  1,   3  and 
5  except  in  the  case  of 
form  of  letters,  in 
which  case  the  values 
were  3,  4  and  6.  The 
value  of  any  sample  by 
this  scale  is  equal 
to  the  sum  of  its 
values  in  all  of  the 
five  qualities. 


Scale  of  sev- 
en steps ;S0- 
30,  40-50, 
60-70,  75, 
80,  85,  and 
90-95.  Un- 
der each 
specimen  are 
suggested 
its  particu-5 
lar  defects. 


Reached  the 
conclusion 
that  the 
so-called 
exposure 
method  used 
here  is  the 
most  relia- 
ble method 
known, of 
testing 
legibility. 


A  scale  con- 
sisting of 
five  charts, 
each  chart 
containing 
three  sam- 
ples of 
handwriting 
and  repre- 
senting 
three  degree 
of  merit  in 
one  of  the 
five  quali- 
ties. 


TManual  of  Penmanship  and  Guide  to  Rating.     New  Haven,  1913. 
2The  Measurement  of  Handwriting.     Journal  of  Educational  Psychology. 
Oct.,  1913. 

3Anl£na3?S-§§&  Scal©  for  Judging  Handwriting.  El. School  Journal.  Vol. 
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Withaml      Handwriting  1915 


Measurement  of  speed, 
legibility,  and  form 
or  "beauty.     All  these 
combined  by  Weiss  in- 
dex method,  giving 
each  equal  weight,  „ 
gives  "general  merit 
or  rank  of  any  sample. 


Combination 
of  former 
methods;  no 
new  scale 
devised. 


C . Truman 
Gray2 


Handwriting  1915 


A  list  of  the  qu^Lities 
which  go  to  make  up 
excellence  in  handwrit- 
ing submitted  to  a  num- 
ber of  judges  and  ranked 
according  to  their 
importance.     The  upper 
nine  from  this  list  again 
submitted  to  a  new  set  of 
judges  and  ranked  again 
in  the  same  way.  These 
rankings  translated  into 
percentage  values  on  the 
basis  of  a  total  of  one 
hundred. 


A  ecorecard, 
on  which  are 
nine  quali- 
ties each 
with  a  def- 
inite value 
attached. 


Freeman*5    Handwriting  1915        Investigation  of  speed  and  Standard 

quality  of  handwriting  in  scores  for 

grades  II-VHI  in  cities  each  grade 

of  more  than  30,000  pop-  (II-VIII) 

ulation.    Also,  a  ques-  in  speed 

tionaire  investigation  and  quality 

of  the  opinion  of  busi-  quality  be- 

ness  men  as  to  the  qual-  ing  raeas- 

ity  of  handwriting  neces-  ured  on  the 

sary  in  business;  quality  Ayres  scale 

being  measured  on  the  and  speed, 
Ayres  scale.     Smoothing  the/n  letters 

curve  representing  the  per  minute 
upper  quartile  of  measure-  written, 
ment,  influenced  by  busi- 
ness men's  opinions, 
gives  standards. 


All  theElements  of  Handwriting  Measured.  Ed'nal,  Admin,  and  Sup. 
May,  1915.  Method  of  Measuring  Handwriting. School  Ed. Journal, May, 
1914. 

A  Score  Card  for  the  Measurement  of  Handwriting.     Bulletin  of  the 

University  of  Texas.  1915.  No.  37. 
Handwriting.  14th  Yearbook  of  the  National  Society  for  the  Study 

of  Education.  Pp.  61-73. 
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C our tie1    Handwriting  1915 


Pice2 


Language  1903 


Thorndike3  Reading  1914 


Investigation  of  the 
rate  of  writing  an 
original  story  and 
rate  of  writing  a 
reproduction  of  a 
story  read.  Ftandards 
based  on  rates  of  large 
numbers  of  pupils. 


Standard 
rates  for 
writing  in 
each  of  the 
grades  (IV- 
VIII}  inc. 


Pupils  tested  as  to 
structure  of  sentences 
and  excellence  of  form 
reproduction  of  a 
selection  read  aloud 
to  them.     Tests  given 
in  person,  by  Rice  ,to 
8300  pupils. 


Great  amount 
of  overlap- 
in  ping  between 
the  succes- 
sive grades 
discovered. 
No  scale 
given. 


Eleven  hundred  pupils  Tentative 
tested  for  comprehension,  scale  pre- 
Twenty-five  hundred  sented,  sub- 

tested  for  visual  ject  to  fur- 

vocabulary.     These  tests    ther  testing 
given  in  grades  V-VIII.      and  revision 
Nine  lists  of  words 
prepared.     Pupil  asked  to 
mark  each  one  in  a  certain 
way  to  show  that  he  recog- 
nized it.     To  test  under- 
standing, passages  pre- 
pared, ranging  in  length 
from  a  short  sentence  to 
a  paragraph  of  ordinary 
length,  and  covering 
similar  range  in  diffi- 
culty of  ideas  contained. 
Ranking  of  pupil  then 
is  on  basis  of  words  re- 
cognized and  ideas  correctly 
reproduced. 


^Standards  in  Rates  of  Reading.  14th  Yearbook  of  the  National  Society 

for  the  Study  of  Education,  Pp.  44-59. 
2Educational  Research.     The  Results  of  a  Test  in  Language.  Forum, 

Vol.   35,   Pp.  369- 
3The  Measurement  of  Ability  in  Reading.     Teachers  College  Record. 

May,  1914. 
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W. S.Gray1  Oral  Reading  1914      A  series  of  ten  para-         A  provisional 


F.J.Kelly3  Silent  Read-  1915 


ing 


Courtis3    Reading  1915 


graphs  of  increasing 
difficulty,  due  to  the 
increasingly  long  and 
difficult  words.  Series 
tested  on  three  groups 
of  pupils  in  three 
schools  with  rather 
uniform  results. 


scale  for 

measuring 

ability  to 

pronounce 

English 

sentences. 


Sixteen  short  passages 
framed  to  test  the  pu- 
pil's ability  in  silent 
reading.     These  given 
to  pupils  with  direc- 
tions to  make  certain 
marks  or  underscore 
particular  words  if 
certain  things  were 
true  ,from  the  passages 
read.    A  value,  deter- 
mined by  the  time  re- 
quired to  read,  given 
to  each  passage.    No  passage 
counted  unless  it  was  read 
correctly.  Reading 
ability  represented  by  the 
scores  made  in  five  min- 
utes.    Three  sets  of 
tests,  differing  somewhat 
in  difficulty,  given  to 
three  classes  of  pupils; 
grades  III-V  inc.,  VI-VIII 
inc.,  and  high  school 
classes.     Fifteen  hundred 
pupils  tested  in  (III-VII); 
somewhat  smaller  numbers 
in  the  higher  classes. 
Standards  for  each  grade 
worked  out  on  basis  of 
these  scores. 


Tests  for 
silent  read- 
ing and 
standard 
scores  for 
each  of  the 
grades  III- 
XII. 


Pate  of  reading  the  comple- 
tion of  interesting  story 
measured,  and  words  per 
minute  calculated;  pupil 
being  able  to  reproduce 
50^  of  the  ideas  in  a 
400  word  passage. 


Standard 
scores  in 
words  read 
per  minute 
for  grades 
17- VI II. 


1A  Provisional  Scale  for  Measuring  Ability  to  Pronounce 
(C^?9SgegextTglS§!r3  College  Record,  May,  1914. 


English 
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Starchl      Reading  1915 


Speed  of  reading  and 
comprehension  measured. 
Number  of  words  read 
in  thirty  seconds  repre- 
sents speed;  number  of 
words  correctly  ex- 
pressing ideas  con- 
tained in  the  passage 
represents  comprehen- 
sion.    Curve  for 
achievement  by  grades 
secured  by  smoothing 
the  curve  which  repre- 
sents the  medians  of 
the  scores  obtained  from 
an  application  of  these  t 
to  3511  pupils. 


Standard 
scores  for 
grades  I- 
VIII  in 
comprehen- 
sion given, 
based  on 
the  median 
scores  of 
pupils  test- 
ed. Tests 
given  also. 


ests 


Rice2         Spelling       1897       Arbitrarily  selected  List  of 

words  dictated  both  150-300 

as  single  words  and  in  words  sug- 

sentences.    Also,  geeted. 

tests  by  original  No  definite 

composition.     Study  scale, 
unscientific;  33000 
pupils  tested  under 
various  conditions. 


Cornman3    Spelling       1902       Used  Rice's  column  test,     Four  column 

vertical  list  of  words,      tests  and 
words  in  sentences,  words  sentence 
in  a  composition  >and  words/tests  with 
written  spontaneously  median 
for  fifteen  minutes.  scores  for 

srrades  III- 
VIII. 

SThe  Kansas  SilenFTteading  t esti7™ "Bureau ~oT" Educational  Measure- 
ments  and  Standards.     State  Normal  School.     Emporia,  Kansas. 

Standards  in  Rates  of  Reading.  14th  Yearbook  of  the  National  Society 
for  the  Study  of  Education.  Pp.  44-59. 

IThe  Measurement  of  Efficiency  "iiT Reading .     Journal  of  Ed.  PsychT " 
Vol.  6,  Pp.  1-24. 

2The  Futility  of  the  Spelling  Grind.     Forum.  Vol.  XXIII.  Pp.  163-J73 
and  409-419.     Scientific  Management  in  Education.  N.Y.  1913. 
Hinds,  Noble  and  Eldridge. 

3Spelling  in  the  Elementary  School.  Boston,  1903.  Ginn  and  Do. 
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Wallin1      Spelling       1911        Two  methods  used:  a 

composition  in  which 
were  test  words  copied 
by  pupils,  and  a  column 
test,  in  which  occurred 
one  column  of  forty 
words  for  each  grade. 
Grades  IV-vm  tested. 


Column  lists 
of  words 
offered, 
hut  no 
standard 
scores  af- 
fixed. 


eats  con- 
sisting of 
twenty- 
five  word 
lists  of 
gradually 
increasing 
difficulty. 


Buckingham2  Spelling    1913        5000  words  taken  from  5 

popular  spelling  books. 
270  words  selected  from 
this  list  and  submitted 
to  8791  pupils  in  grades 
III-VIII  and  to  11  grades 
in  New  York  City.  100 
words  showing  most 
consistent  rise  in  cor- 
rect spelling  by  grades 
submitted  again  to  large 
number  of  pupils  and 
from  these, twenty-five 
word  list s  selected, 
ranging  from  easy  to  dif-, 
ficult'by  approximately 
equal  step 8. 

Ayres3        Spelling       1913        Selections  made  from  words  Tests  con- 


spelled  by  a  large  num- 
ber of  pupils.  Selec- 
tion of  a  number  of  words 
for  each  grade,   such  that 
70$  of  the  pupils  of  any 
grade  could  spell  all 
of  the  words  of  that 
grade  correctly. 


sisting  of 
ten  words 
for  each  of 
the  grades. 


^Spelling  Efficiency.    Baltimore,  1911.  Warwick  and  York. 
^Spelling  Ability,  Its  Measure  and  Distribution.     Teachers  College 

Contributions  to  Education.  No.  59,  1913. 
3The  Spelling  Vocabularies  of  Personal  and  Business  Letters. 

Monograph    of  the  Division  of  Education  of  the  Russell  Sage 

Foundation,  New  York.  1913. 
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Starch^      Spelling       1914       First  defined  non-  Six  column 

technical  word  on  each       tests  and 
page  of  Webster's  New  standard 
International  Dictionary,  scores  for 
600  of  the  more  common       grades  II- 
of  these  selected.  VIII. 
These  divided  by  purely 
random  selection,  into 
six  100-word  lists; 
each  list  of  approxi- 
mately equal  difficulty. 
These  lists  given  to 
3500  school  children  and  from 
the  smoothed  curves  repre- 
senting these  scores 
standards  of  achievement 
for  each  grade  derived. 


Cook  and 
0 ' Shea2 


Spelling  1914 


A  large  mass  and  variety 
of  correspondence  exam- 
ined, and  words  select- 
ed for  the  lists  on  the 
basis  of  the  frequency 
of  their  occurrence. 
Words  arranged  in  three 
lists  in  the  order  of 
their  frequency  of 
occurrence  and  hence, 
presumably,  the  order 
of  their  importance. 


Three  lists 
of  words: 
(1st. list, 
372)  (3nd 
list,  543) 
(3rd  list, 
344) 


Ayres' 


Spelling  1915 


The  one  thousand  most 
commonly  used  words 
in  all  sorts  of  writ- 
ings selected  on  the 
basis  of  their  fre- 
quencies of  occurrence 


Twenty-six 
columns  of 
words  (A- .7!) 
with  the 
average 
percentage 


TThe  Measurement  o: 

167-186. 
(Cont.  on  next  page) 


in  four  comprehensive  list$>f  correct 
worked  out  by  earlier  spellings 
investigators.     These         to  be  ex- 
thousand  words  given  pected  of 
as  tests  to  consecutive      each  grade, 
grades  in  eighty-four 
cities  (fifty  twenty- 
word  lists.  Difficulty 
of  each  word  for  each 
grade  determined  on 
basis  of  scores  of 
seventy  thousand  pupils 
in  grades  II-VIII. 
: i c rency  in  SpeTITn g.Jr.of  Ed.Piy cTT.  Vol.  6,  Pp. 
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P . G.  Jones1  Vocabulary  1915      Words  occurring  in  ten        List  of  eigh 

primers  as  many  as  ten  ty-seven 
times,  divided  into  two      words,  with 
Jists;  phonetic  words         a  particu- 
and  sight  words.  Pho-         lar  value 
netic  words  given  attached 
value  corresponding  to  the  to  each, 
number  of  times  it  and  any  other 

members  of  the  same  word- 
family  occurred.  Sight 
words  given  only  the 
value  corresponding  to 
their  own  occurrence. 
Thus,  a  particular  value 
corresponding  to  the 
particular  word,  deducted 
from  the  total  possible 
score  (the  value  of  the 
whole  list)  for  each  word 
not  recognized. 


Haggerty2  Arithmetic  1915 


Courtis  tests  given  to 
approximately  nine 
thousand  school  chil- 
dren in  twenty  Indiana 
cities.     Indiana  Stan- 
dard of  speed  and 
accuracy  ("depende- 
bility")  proposed  on 
the  basis  of  the 
medians  of  these  scores 
for  each  of  the  four 
fundamental  arithmetical 
operations. 


Indiana 
Standard  for 
achieve- 
ment in 
Court i 8 
tests. 


I 


Cont.  J" 
The  Child 


and  His  Spelling.  Indianapolis,  1914.  Bobbs-Merrill  Co, 


3A  Measuring  Scale  for  Ability  in  Spelling.  Division  of  Education 
of  the  Russell  Sage  Foundation.  New  York,  1915. 

lReading:  14th  Yearbook  of  the  National  Society  for  the  Study  of 

Edn.  Pp.  37-44. 
3Indiana  University  Bulletin,  No  .  11  .Oct.  1915. 
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B.  Testing  the  Handwriting  Scales.   (Including  a  table  of 
equivalent  values  on  the  two  scales) .     Had  the  writer  been  able 
to  secure  the  assistance  of  a  few  persons  for  a  longer  time  he 
would  probably  have  used  one  of  the  analytic  scales.    A  large 
number  of  superintendents,  however,  were  willing  to  devote  the 
time  necessary  to  rate  the  sample  in  the  Ayres  or  the  Thorndike 
scale,  but  none  was  willing  to  take  the  necessary  time  to  rate  by 
such  scales  as  those  of  Freeman,  Gray  or  Houston.     The  ratings 
would  obviously  have  been  unreliable  as  a  basis  of  comparison 
unless  all  samples  were  rated  by  all  persons,  and  this  being  pos- 
sible only  by  use  of  the  Ayres  or  Thorndike  scale, it  was  deemed 
best  to  select  one  of  these. 

First,  all  of  the  twelve  hundred  samples  were  rated  on 
both  of  these  scales.     A  group  of  graduate  students  in  Education 
at  the  summer  session  of  the  University  of  Illinois  (most  of  whom 
were  school  superintendents)  was  divided  into  two  sections  of 
ten  members  each.     One  section  rated  the  samples  on  the  Ayres 
scale  and  the  other  on  the  Thorndike  scale. 

Though  the  two  scales  were  constructed  in  different 
ways  (the  Ayres  scale  on  the  basis  of  legibility  alone  and  pur- 
porting to  measure  only  that  one  quality),  it  has  been  demonstrated 
with  a  fair  degree  of  certainty  that  they  do,  in  practice,  measure 
the  same  thing,  namely,  forml.     other  things  being  practically 
equal  then,  it  was  thought  best  to  use  the  scale  on  which  the 
ratings    showed  the  less  variability.     In  order  to  determine  this 
variability  it  was  necessary  to  know  the  ratings  on  each  scale 

If.n.  Freeman:  Elementary  School  Journal,  April.  1915.  and 

F.S.  Breed  and  Vernon  Gulp:  School  and  Society,  October  30,1915. 
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in  terms  of  the  other.     For  the  purpose  of  determining  this  latter 
point,  the  writer  secured  ratings  on  both  scales  by  a  class  of 
nine  students  in  Education  at  the  University  of  Illinois.  Three 
hundred  specimens,  including  all  of  the  papers  in  both  tests  from 
one  third  grade,  two  fourth  grades,  one  fifth  grade^nd  one  sixth 
grade  were  thus  rated.    The  distribution  of  these  ratings  is 
shown  below: 


Thorndike  30  30  40  50       60      70  80-Ayres 

Scale  scale 

5  1 

6  16  3 

7  118  60  3 

8  133  613  45  2 

9  13  504  348  30 

10  42  333  101  11 

11  5  40  52  23 
13                                                   14  7 

13  2        5  1 


The  median  of  the  ratings  on  the  Thorndike  scale  falling 
at  any  one  step  of  the  Ayres  scale  has  been  taken  as  the  Thorn- 
dike equivalent  of  that  step  of  the  Ayres  scale.     By  this  method 
the  following  table  of  equivalent  values  has  been  derived. 

Ayres  30         30         40  50  60 

Thorndike   8  8.89      9.81      10.66  11.48 

The  number  of  samples  toward  the  upper  limit  of  the 
Ayres  scale  is  of  course  too  small  to  serve  as  a  basis  for  equating 
values.     Hence,  the  table  reachesna?  far  as  60  on  the  Ayres  scale. 

It  will  te  noted  that  the  steps  on  the  Thorndike  scale 
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which  correspond  to  supposedly  equal  steps  on  the  Ayres  scale 
are  almost  exactly  equal.    According  to  this  table  one  step 
(e.g.,  from  30  to  40)  on  the  Ayres  scale  is  equal  to  nine-tenths 
of  a  step  (e.g.,  from  8  to  9)  on  the  Thorndike  scale.     The  step 
on  the  Thorndike  scale  corresponding  to  the  step  50-60  on  the 
Ayres  scale  shows  a  slight  variation  from  the  consistent  increase 
from  step  to  step  in  the  lower  points  of  the  scale.    The  number 
of  ratings  on  the  Thorndike  scale  falling  under  60  on  the  Ayres 
scale,  however,  is  much  smaller  than  the  number  falling  under  the 
lower  divisions  of  the  scale  and  hence  not  so  reliable.  It 
seems  safe  to  conclude  from  the  remarkably  consistent  values  on 
the  Thorndike  scale  corresponding  to  the  steps  on  the  Ayres  scale 
adequately  covered  by  the  above  distribution,  that  one  step 
on  the  Ayres  scale  is  equal  to  nine-tenths  of  a  step  on  the 
Thorndike  scale.     In  other  words,  the    Ayers       scale  marks 
slightly  finer  divisions  or  stages  of  merit  in  handwriting  than 
does  the  Thorndike  scale- 

The  writer  offers  the  following  table  of  equivalent 
values  in  the  two  scales,  covering  the  entire  range  of  the  Ayres 
scale : 

Ayres  scale  30        30        40        50        60        70        80  90 

values 

Thorndike  scale-  8  8.9      9.8    10.7    11.6    12.5    13.4  14.3 

Starch  has  given  the  following  equivalent  values  on  the 
Ayres  and  Thorndike  scales*: 

Thorndike  scale-  7  8  9  10  11  13  13  14 
Ayres  scale  33        31         40      49        58        67        ?6  85 

*See  Journal  of  Educational  Psychology.  Oct. 1913,  Pp.452  and  Feb. 
1915,   Pp.  107. 
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According  to  this  table  of  values,  one  step  on  the 
Thomdike  scale  is  equal  to  nine-tenths  of  a  step  on  the  Ayres 
scale.     On  the  basis  of  these  equilalent  values  the  conclusion  would 
be  that  the  Thomdike     scale  marks  somewhat  finer  divisions  than 
the      Aysrs     scale,  contrary  to  the  conclusion  based  on  the 
distribution  of  ratings  in  the  two  scales  shown  above. 

The  basis  of  Starch's  tables  is  the  ratings  of  fifteen 
samples  of  children's  handwriting  by  twenty  persons  (ten  business 
men  and  ten  teachers)  on  both  of  the  scales.     The  number  of  per- 
sons rating  the  samples  in  Starch's  investigation  is  thus  two 
more  than  twice  the  number  rating  in  the  present  investigation. 
The  number  of  samples  rated  in  the  present  investigation  was  just 
twenty  times  the  number  rated  by  Starch's  judges.    The  writer 
believes  that  the  relatively  larger  number  of  samples  rated  and 
the  uniform  steps  on  the  Thomdike  scale  corresponding  to  equal 
steps  on  the  Ayres  scale  justify  him  in  presenting  hie  table  of 
equivalent  values,  with  a  good  deal  of  confidence. 

In  comparing  the  variability  of  the  twelve  hundred  hand- 
writing specimens  on  the  two  scales,  a  step  on  one  scale  was  count- 
ed equal  to  a  step  on  the  other.     It  was  found  that  the  ratings 
of  these  specimens  were  more  variable  on  the  Thomdike  scale  in 
64.6fr  of  the  total  number  of  papers.     Although  this  comparison 
favored  the  Ayres  scale,  another  point  came  out  in  the  form  of 
the  distribution  shown  above  which  made  it  impracticable  to  use 
the  Ayres  scale  in  this  particular  investigation.    The  way  in 
which  specimens  representing  a  wide  range  on  the  Thomdike  scale 
cluster  at  the  lowest  step  of  the  Ayres  scale  points  inevitably 
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to  the  conclusion  that  the  Ayres  scale  does  not  enable  one  to 
discriminate  between  specimens  of  so  low  a  qu&ity  as  some  of  the 
samples  included  in  the  present  investigation.     For  this  reason 
the  writer  decided  to  use  the  Thorndike  rather  than  the  Ayres 
ratings,  and  the  data  on  handwriting  which  appear  later  in  this 
study  are  based  on  the  ratings  in  the  former  scale. 
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CHAPTER  IV. 
THE  PRESENT  INVESTIGATION 

A.    Aim  and  General  Characteristics. —  The  present  study 

differs  to  a  considerable  extent  in  aim  and  in  method  from  the 

teacher-rating  studies  and  scales  that  have  been  reviewed.  The 

earlier  scales  have  been  intended  usually  to  measure  a  teacher  - 

of 

a  person  -  in  all Ahis  activities  and  relations.     The  present  study 
aims  to  secure  a  reliable  method  for  estimating  the  worth  of  a 
process.     The  writer  has  not  attempted  to  consider  all  of  the 
qulities  which  enter  into  the  general  efficiency  of  the  teacher. 
In  so  far  as  his  form  involves  the  measurement  of  a  teacher,  it 
measures  him  in  one  particular  phase  of  his  activity;  the  teaching 
process.     The  study  is  essentially  an  intensive  one,  whereas  the 
earlier  studies  have  been  comparatively  extensive.  Earlier 
students  of  the  problem  of  teacher-rating  have  distributed  their 
time  and  attention  over  the  broad  field  which  is  included  under 
the  "total  efficiency"  of  the  teacher.     The  writer  appreciates  the 
importance  of  qualities  of  the  teacher  which  have  appeared  on 
earlier  scales  but  which  have  not  been  included  in  the  present  list 
Many  of  them  are  qualities  which  are  important  in  almost  any 
occupation  or  profession,  and  undoubtedly  are  determining  factors 
in  the  "total  efficiency"  of  the  teacher.     It  has,  however,  seemed 
more  feasible  in  following  up  these  pioneer  studies  to  limit  the 
investigation  to  one  division  of  that  "total  efficiency";  namely, 
the "classroom  work  that  is  involved  in  the  actual  teaching  process. 
The  method  of  securing  the  data,  which  seemed  most  reliable,  made 


 ,  .  ,  — —  —  ' — — — — —  

-Sl- 
it doubly  necessary  that  a  comparatively  limited  phase  of  the 
teacher's  activities  be  investigated. 

In  endeavoring  to  find  a  basis  for  judging  teaching 
efficiency, somewhat  different  from  that  of  earlier  studies,  the 
writer  wishes  to  emphasize  the  fact  that  he  is  not  attempting 
to  discredit  the  work  of  the  earlier  investigators,  or  even  to  say 
that  such  scales  are  no  longer  valuable.     There  is  undoubtedly 
a  place  for  some  scale  so  comprehensive  as  those  of  Elliott, 
Eoyce^and  Witham.     It  is  unquestionably  desirable  that  a  superin- 
tendent should  have  a  scale  which  will  help  him  to  estimate  the 
"total  efficiency"  of  his  teachers.    A  scale  narrower  in  scope 
would  obviously  be  unfair  as  a  basis  for  salary  increase.  The 

total-efficiency" type  of  scale  is  a  valuable  administrative  de- 
an d 

vice,  but  it  is  not,^.n  the  writer '3  opinion,  will  not  be  used 
generally  in  the  supervision  of  teaching. 

The  present  list  of  items  has  been  formulated  in  the 
course  of  an  attempt  to  discover  the  elements  which  constitute 
the  worth  of  the  teaching  process.     It  should  be  used  cooperative- 
ly   by  superintendents  and  teachers:  by  the  former  primarily 
as  a  basis  for  suggestions  to  his  teachers,  and  by  the  latter 
as  an  aid  in  analyzing  their  own  teaching,  in  checking  their  pro- 
gress from  day  to  day,  and  in  enabling  them  to  cooperate  with  the 
superintendent  in  his  efforts  toward  their  improvement. 

Any  scheme  for  rating  teaching  efficiency,  to  be  relia- 
ble, must  have  a  reasonable  justification  for  the  items  which 
it  includes.     Further,  it  is  very  desirable  that  the  relative 
values  of  each  of  the  items  should  be  known  at  least  approximately. 
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It  ie  necessary,  too,  that  the  various  items  should  be  so  clear 
and  definite  that  they  will  not  be  misunderstood,  or  understood 
in  different  ways  by  the  various  people  using  the  scale. 

Ruediger  and  Strayer,  and  Boyce  in  his  earlier  scale, 
used  a  comparatively  short  list  of  qualities.     One  of  the  criti- 
cisms which  Boyce1  himself  makes  of  these  studies  is  that  they 
include  terms  which,  unanalyzed,  may  vary  in  their  meaning  accord- 
ing to  the  people  using  the  scale.     Such  terms  are  "personality" 
and  "teaching  skill". 

In  his  later  study,  Boyce  presents  a  much  more  carefully 
prepared  list  of  qualities,  which  is  at  the  same  time  a  much 
longer  one.     The  scales  of  Elliott  and  Witham  and  this  revised 
scale  of  Boyce  have  a  very  long  list  of  items.     They  are  not  to 
any  great  extent  subject  to  the  criticism  just  quoted  from  Boyce, 
but  the  great  number  of  items  included  makes  them  rather  cumber- 
some in  use,  and  still  further  complicates  the  process  of  evalua- 
ting the  items  by  any  other  than  an  arbitrary  method.     Only  one 
principal  among  thirty,  in  replying  to  a  questionaire  in  regard 
to  the  scales  for  teacher- rating  in  use,  reported  that  he  was  us- 
ing the  Elliott  scale.    He  adds,   "Personally,  I  am  inclined 
to  summarize  the  Elliott  scheme,  because  I  find  it  hard  to  esti- 
mate each  element".     The  present  scale  has  the  advantage  of  a 
comparatively  small  number  of  items.     At  the  same  time  it  is  free, 
with  one  possible  exception,  from  the  blanket  terms  which  have  been 
adversely  criticized  in  earlier  scales,  and  in  the  case  of  this 

!l4th  Yearbook  of  the  National  Society  for  the  Study  of  Education. 
Part  II,  P.  43. 
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questionable  term  the  suggestive  topics  which  are  placed  under  it 
practically  remove  the  chance  of  misunderstanding.    This  item, 
"governmental  skill",  was  taken  Elliott* s  scale:  The  same  term 
was  used  by  Boyce  in  his  first  investigation. 

B    Method  of  the  Investigations    1.    Determining  the 
Items  which  should  Compose  the  Rating  Form.-    As  a  preliminary 
step  in  securing  the  items  for  the  scale  the  writer  made  a  care- 
ful study  of  literature  on  the  subject  of  teacher-rating  (includ- 
ing the  studies  previously  mentioned),  as  well  as  a  careful  exam- 
ination of  many  of  the  local  schemes  in  use.    A  tentative  list  of 
twelve  qualities  was  first  formulated.    This  list  was  presented 
before  a  conference  of  eighteen  people,  and  there  discussed  for 
two  hours.    Four  of  the  people  present  at  this  meeting  were  uni- 
versity professors  of  education.    The  others  were  interested  in 
educational  problems  and  most  of  them  were  schoolmen  of  some  ex- 
perience1.   As  a  result  of  this  conference  a  number  of  items 
were  dropped,  several  others  were  formulated  in  slightly  differ- 
ent terms,  and  several  new  items  were  added.    The  items  of  the 
scale,  as  finally  formulated  and  used  in  rating,  represent  very 
closely  the  concensus  of  opinion  of  these  men  in  regard  to  the 
elements  which  constitute  good  teaching  in  the  elementary  school. 


For  a  list  of  these  men,  see  the  Appendix 


The  form  used  in  the  thirteen  schools  investigated  is  shown  below: 
Scale  for  Rating  Qualities  of  Classroom  Efficiency  in  Elementary  School  Teachers 


Speech- 


Check 
"good  or  had 


(Modulation)    -    - 

(  Clearness  of  Enunciation 

(Bate)     

(Quality  (Nasal   

(Throaty    —  — 


X 

o 

CD 
CD 

3 


s 

o 


o 
o 

H 


< 
CD 
H 
*< 

O 

o 


Governing  Skill  —  -  -  —  —   -j 

(a )Cheer fulness 
Check         (b)Naturalness   -  —  -  -  -  — 

(c )  Const rained  obedience  ---------- 

(d)  Disobedienco    --------  —  _   


Use  of  English  

Check         (a)By  teacher 
«goodMor  nbadw(b)By  pupils 
k  


Skill  in  organization  of  material 
of  the  recitation  ------- 


Ability  to  fix  the  recitation  in  its  proper 
setting  in  the  course,  i.e.,  making  the 
proper  connections  with  preceding  and  with 
following  recitations  ---------- 

6. Proper  Stressing  of  relative  values,  i.e. 
distinguishing  fundamental  from  accessory 


7.  Skill  in  Habit-formation 


8.  Skill  in  questioning 


(a)  Thought-provoking    -  ■ 

(b)  Clear    -  -  ■ 

(c)  Too  many 

(d)  Too  difficult  ■ 

(e)  Irrelevant  -  -  -  -  - 

(f)  Suggesting  the  answer 
9*  Skill  and  care  in  assignment    -  -  -  ■ 

10.  Choice  of  illustrative  material  -  -  ■ 


School    ---------    Teacher    ----------  Grade 

Date  —  ' 
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Items  3,  4,  5,  6,  8,  and  10,  are  factors  so  obvious 
and  invariable  in  the  normal  recitation  that  they  hardly  need 
justification  in  a  list  of  items  which  is  to  be  used  in  investi- 
gating the  efficiency  of  teaching.     Assignment  certainly  means 
a  quite  different  thing  in  the  lower  grades  from  what  it  means 
in  the  higher  grades,  and  this  was  taken  into  account  by  the  per- 
sons who  used  the  form.     It  is  a  necessary  part  of  the  recita- 
tion, though,  even  in  the  lower  grades.     Choice  of  illustrative 
material,  too,  varies  very  much  in  importance  with  the  subject 
of  study.     The  judges  were  obliged  to  use  their  discretion  in  re- 
gard to  how  much  to  deduct  from  a  score  of  "excellent"  on  account 
of  the  inadequacy  of  the  illustrative  material  in  any  particular 
recitation.     "Skill  in  Directing  Habit  Formation"  might  easily 
be  confused  with  "Governing  Skill".    The  same  act  on  the  part 
of  a  pupil  might  be  considered  at  one  time  due  to  the  teacher's 
lack    of  ability  in  directing  habit- format ion,  and  at  another 
time  as  due  to  his  lack  of  governing  skill.     The  determining 
factor  in  such  cases  must  be  the  apparent  intention  or  attitude 
of  the  pupil.     If  a  pupil  habitually  leans  against  his  desk  on 
recitation  and  no  notice  is  taken  of  the  fact  by  the  teacher, 
the  fault  is  accounted  due  to  a  lack  of  ability  in  directing 
habit- format ion.     The  same  act  might  in  other  cases  be  done  in 
spite  of  the  teacher's  evident  wishes  to  the  contrary.     When  such 
things  are  done  in  defiance  cr  surreptiously  they  are  accounted 
due  to  the  teacher's  lack  of  governing  skill.     Governing  ability 
is  not  here  understood  as  merely  negative  or  repressive  in  its 
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reeults.     The  teacher  who  controls  chiefly  by  repressing  is  not 
a  good  disciplinarian.    He  will  accomplish  the  highest  type  of 
government  or  discipline  only  when  he  inspires  his  pupils  with 
a  respect  for  learning,  and  to  do  this  he  must  not  only  make  the 
work  worth  while,  but  he  must  make  the  pupils  feel  that  it  is 
worth  while. 

There  was  considerable  doubt  at  first  as  to  the  propri- 
ety of  including  Speech  as  one  of  the  items  of  the  list.  After 
preliminary  testing,  however,  it  was  decided  that  this  should 
be  included.     Its  importance  to  any  recitation  is  large  and 
unquestionable.     When  the  teacher's  voice  is  poor  in  any  of  the 
qualities  which  occur  under  the  head  of  Speech  the  effect  upon 
the  success  of  the  recitation  is  very  likely  to  be  felt.    As  one 
of  the  items  of  the  scale,   speech  has  the  advantage  of  being 
always  present  in  the  recitation.    Again  there  is  little  danger 
that  two  judges  using  the  3cale  will  consider  different  things 
in  rating  under  this  head,  with  the  suggestive  sub-headings.  The 
sub-topics  were  added  under  items  1,  2,  3  and  8,   simply  as  sug- 
gestions to  the  person  using  the  scale,  as  to  the  particular 
points  for  which  he  should  look  in  forming  his  estimate  of  the 
item. 

2.    Method  of  Rating.     Eoyce  has  pointed  out,  as  one 
of  the  "fundamental  needs  for  the  final  solution  of  the  problem 
of  rating  teaching  efficiency  that  we  must  have  command  of  situa- 
tions in  which  two  or  more  officials  may  test,  on  the  same  body 
of  teachers,  whatever  method  is  employed,     In  the  present  investi- 
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gation  the  plan  adopted  was  to  have  the  writer  and  one  other  per- 
son rate  each  teacher  in  the  two  school  systems  twice ^with  an 
interval  between  the  ratings.     As  many  as  four  ratings  were  not 
secured  for  every  teacher,  but  this  was  the  aim,  and  no  teacher 
was  rated  less  than  twice.     The  author  rated  each  teacher  in  the 
two  cities  twice,  with  the  exception  of  one  school.     In  this  case 
examinations  were  in  progress  when  he  made  his  second  visit,  and 
hence  it  was  impossible  to  secure  a  satisfactory  rating  on  teach- 
ing.    The  several  ratings  were  desired  in  order  to  eliminate 
the  element  of  chance  which  might  sometimes  make  a  single  rating 
misleading.     It  was  thought  that  the  average  of  a  number  of 
ratings  would  represent  a  fairer  estimate  of  the  teaching,  and 
that  any  correlations  that  might  be  worked  out  between  such  rat- 
ings in  any  of  the  items,  and  any  more  general  test  would  be,  in 
so  far  as  the  items  are  concerned,  more  relEble. 

In  Boyce's  first  investigation  the  superintendents  made 
the  rankings  in  the  particular  qualities  of  the  scale  and  then 
made  a  general  ranking  (a  ranking  on  the"total  efficiency"  of  each 
teacher).     For  two  reasons  this  plan  of  procedure  was  modified 
in  the  present  investigation.     The  writer  wished  to  have  the  rat- 
ings based  on  specifically  observed  classroom  work  rather  than 
past  impressions,  and  he  hesitated  to  ask  the  superintendents  to 
take  the  time  necessary  to  make  such  ratings.     (Such  a  request 
was  made  later,  with  good  results,  as  is  shown  in  one  of  the 
following  chapters  of  the  study).     Again,  it  was  thought  that  in 
having  the  general  ratings  and  the  scale  ratings  made  by  different 
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persons,  any  correlations  which  might  be  worked  out  between  the 
two  might  be  more  nearly  free  from  error.     In  other  words,  it  was 
hoped  to  avoid  whatever  chance  there  might  have  been  in  the 
earlier  method,  of  making  the  general  rating  too  much  like  a 
summary  of  the  detailed  ratings  on  the  scale. 

The  superintendents  were  first  asked  simply  to  distri- 
bute their  teachers  into  five  groups:  Excellent,  Good,  Fair, 
Poor,  and  Very  Poor.     It  was  explained  to  them  that  Excellent 
should  include  the  exceptionally  strong  teachers;  Fair,  the  aver- 
age teachers;  and  Very  Poor,  the  exceptionally  weak  and  unsatis- 
factory teachers.     The  following  distribution  of  the  teachers  in 
these  two  school  systems  shows  what  is  probably  a  general  tendency 
among  superintendents  to  rank  their  teachers  high  in  the  scale 
of  ability. 

Excellent        Good       Fair       Poor       Very  Poor 

Superintendent 

of  City  B  15  12  3  0  0 

Superintendent 

of  City  P  18  19  18  1  0 

While  it  was  thought  best  to  have  the  ratings  made  on 
different  recitations  by  the  different  judges,  in  order  to  get  a 
fair  average  estimate  of  the  teaching  ability,*  it  was  also  thought 
necessary  to  test  in  some  way  the  extent  to  which  each  item  on 
the  scale,  in  practice,  mean  the  same  thing  to  different  people 
using  it,  and  hence  the  extent  to  which  independent  ratings  by  it 
are  comparable.     In  order  to  test  the  scale  on  this  point,  the 
writer  persuaded  a  superintendent  of  many  years  experience  in 
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praotical  supervision  (at  present  a  graduate  student  in  Education 
at  the  University  of  Illinois),     to  rate  with  him  the  teaching 
in  seven  rooms  of  an  elementary  school.     After  discussing  the  ten 
items  on  the  scale  the  two  men  visited  the  same  recitations,  each 
making  his  rating  independently  of  the  other.     The  ratings  were 
made  on  a  scale  of  ten;  "1"  representing  "Excellent "; "3-3",  "Good"; 
"4-5-6-7",   "Fair";  "8-9",   "Poor";  and  "10",   "Very  Poor".  The 
ratings  correspond  rather  closely,  as  shown  in  the  following  table. 

Room  1  Room  2  Room  3  Room  4  Room  5  Room  6  Room  7 


Judges  H— J  H— J  H— J  H— J  H— J  H— J  H— J 

Scale 

Ratings  1  3—3  3—3  4—6  5—3  3—3  3—3  7—7 

2  2—2  3—2  4—3  3—3  3—3  4—4  6—5 

3  3—6  4—3  3—7  3—3  3—5  3—2  6—6 

4  4—2-  4—2  6—3  3—4  6—5  7—6 
5 

6  2—4  3—2  6—3  3—5  4—4  7—7 

7  3—3  3—3  5—2  5—6  4—6  5—5  4—6 

8  3—2  3—2  5—3  4—3  3—5  3—4  5—7 

9  8—7  8—9 
10  6—2  4—2  6—4  6—4 


In  only  two  instances  do  the  ratings  of  the  two  judges 
differ  by  as  much  as  0.4  of  the  range;  in  four  instances,  by  0.3; 
in  fifteen  instances,  by  0.3;  in  twenty-two  instances,  by  0.1;  and 
in  ten  instances  they  exactly  coincide.     This  correlation  is 
close.     The  writer  had  rated  some  of  these  teachers  before,  and 
it  is  quite  possible  that  his  ratings  in  this  instance  were  to 
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some  extent  influences  by  impressions  gained  in  former  ratings. 
The  correlation  between  the  two  series  of  ratings  shown  here  might 
have  been  still  closer  had  he  known  absolutely  nothing  of  the 
work  of  these  teachers,  as  was  the  case  with  the  other  person  who 
rated.     Both  judges  found  it  extremely  difficult  to  distinguish 
ten  degrees  of  ability.     Had  only  five  divisions  been  used,  as  in 
the  earlier  testing,  the  correlation  between  the  judgments  would 
have  appeared  much  closer.     Between  the  ratings,  as  they  appear 
on  the  preceding  page,  the  correlation  is  0.631.     The  correlation 
between  ratings  similarly  made  on  the  rating  form  of  Ruediger 
and  Strayer  was  0.25. 

3.    Use  of  Objective  Tests.     In  the  earlier  studies  in 
the  field  of  teacher-measurement  some  attempt  has  usually  been 
made  to  include  an  item  which  would  show  in  a  more  or  less  objec- 
tive way  the  effect  of  the  teaching  process.     Elliott  puts  as 
a  sub-topic,   "Examinations;  rate  and  amount  of  progress  of  pupils". 
Boyce  includes  in  his  list  "Growth  of  the  pupil  in  subject  matter".! 
He  suggests  that  "Superintendents  wanting  to  get  at  the  facts 
more  accurately  might  break  up  the  topic  into  growth  in  specific 
kinds  of  subject  matter".     This  refinement  of  the  process  has 
been  attempted  in  the  present  study.     As  tests  could  not  be  given 
in  all  subjects,   it  was  necessary  to  choose  from  among  those 
worked  out,  the  particular  tests  which  seemed  most  practicable 
and  best  established.     In  deciding  this  matter,  the  author  made 

5 

Woodworth  Percentage  of  Displacement  Method  of  Correlation.  See 
Whipple:  Manual  of  Mental  and  Physical  Tests,  p. 38,  for  the 
formula. 
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a  careful  analysis  of  the  testa  which  have  so  far  been  worked  out 
for  elementary  school  subjects.     On  the  basis  of  this  analysis 
and  an  examination  of  the  critical  literature  on  the  subject  of 
tests,   it  was  finally  decided  to  use  the  Courtis  Tests.  Both 
the  Ayres  and  Thorndike  handwriting  scales  were  used  throughout 
finally,  but  the  scores  on  the  Thorndike  scale  were  employed  in 
calculating  the  correlations,  as  the  range  of  merit  measured  by 
the  Ayres  scale  seemed  too  limited. 

Samples  of  handwriting  were  secured  from  all  of  the 
pupils  in  grades  III-VI,  inclusive,  in  one  city  and  in  grades 
IV-VII,  inclusive,  in  the  other  city.    These  samples  were  taken 
early  in  April.     Each  pupil  was  told  to  write  the  following  at 
his  ordinary  rate: "Mary  had  a  little  lamb,  Its  fleece  was  white 
as  snow",  omitting  punctuation1.     The  teachers  were  carefully 
directed  as  to  the  method  of  securing  the  samples  and  as  to  the 
necessity  for  complete  uniformity  in  method  throughout  the  schools. 
Eight  weeks  after  the  first  samples  had  been  taken  another  set 
of  samples  was  secured  in  the  same  way1?' 

The  Courtis  Arithmetic  Tests  (Series  E,  Form  2)  were 
given  to  all  of  the  pupils  in  grades  IV-VI,  inclusive,  in  one  city 
and  in  grades  III-VH,  inclusive,  in  the  other  city.     In  one  city, 
the  interval  between  the  two  tests  was  seven  weeks;  in  the  other 
four  weeks*5.     In  one  city  the  teachers  had  given  the  tests  the 

-'•Samples  of  fast  and  s^ow  writing  were  also  corrected,  "but T'tFese  ~ 
were  not  rated,  as  it  appeared  on  examination  that  most  of  the 
pupils,  in  spite  of  directions  to  the  contrary,  wrote  at  ap- 
proximately the  same  rate  in  all  of  the  three  instances. 

laOwing  to  a  misunderstanding  between  the  investigator  and  the 
superintendent  in  one  of  the  cities  the  second  set  of  samples, 
which  was  to  have  been  collected  at  the  end  of  the  school  year 
was  not  taken.     Hence  the  first  set  of  samples  from  this  city 
(Cont.  on  next  page)  
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preceding  terra,  and  in  view  of  this  fact  were  allowed  to  give 
both  of  the  testa  in  the  present  investigation.     In  the  other 
city  the  first  set  of  tests  was  given  by  graduate  students  in  edu- 
cation, in  the  presence  of  the  teachers.     The  teachers  were  then 
allowed  to  give  the  second  set  of  tests. 

The  writer,  with  the  help  of  one  other  person  who  had 
had  training  in  statistical  methods,  scored  each  of  the  rooms 
from  the  individual  scores  sent  in  from  all  the  schools.  The 
scores  were  calculated  in  "rights"  according  to  the  method  sug- 
gested by  Courtis.     Hence,  the  progress  of  the  pupils  in  the  Cour- 
tis Tests  under  any  teacher  is  represented  by  the  median  number  of 
rights  scored  by  the  pupils  in  her  room      in  the  second  test  minus 
the  median  number  of  rights  scored  in  the  first  test. 

When  a  gain  or  lose  was  shown  between  the  two  handwrit- 
ing tests  it  was  practically  always  represented  by  one  step  of 
the  scale.    Hence,  the  improvement  or  loss  in  any  room  is  calcu- 
lated in  terms  of  the  per  cent  of  the  total  number  of  pupils  in 
the  room  making  a  gain  or  loss;  i.e.,  if  40$  of  the  pupils  gain 
in  the  second  test,  40$  neither  gain  nor  lose,  and  30$  lose,  the 
rank  of  that  room  will  be  represented  by  30$  (40$  gain  minus  30$ 
loss).     When  "-"  precedes  the  per  cent,  it  is  to  be  understood 
as  representing  a  loss. 

4.     Scope  of  the  Investigation.     The  present  investi- 
gation was  carried  out  in  the  thirteen  elementary  schools  in 
CCont. ) 

was  useless  in  measuring  progress. 
3In  order  to  make  the  results  in  the  two  cities  comparable,  the 
author  has  resorted  to  a  method  which  to  some  may  seem  ques- 
tionable.    The  .gain  ,or  loss  in  any  instance,  in  four  weeks  he 
has  multiplied  oy  7/4  when  comparing  with  the  change  in  the 
other  citv  over  a  period  of  seven  weeks. 


-63- 

two  cities  of  Illinois;  one  having  a  population  of  about  ten  thou- 
sand and  the  other  a  population  of  about  sixteen  thousand.  The 
total  number  of  teachers  included  in  this  study  is  86,  and  the 
number  of  pupils,  3895.    The  number  of  teachers  is  not  large,  but 
the  time  spent  in  observing  the  work  of  each  teacher  is,  in  the 
writer's  opinion,  much  more  significant  than  mere  number  of  teachen 
would  have  been.     The  judges  usually  remained  in  a  room  throughout 
an  entire  recitation  and  frequently  longer.    The  recitation  peri- 
ods varied  in  length,  35  minutes  probably  being  a  fair  estimate 
of  the  average  time  required  to  secure  each  of  the  333  ratings. 

The  Courtis  tests  were  given  to  1693  pupils.  Hand- 
writing specimens  were  secured  in  the  first  sampling  from  almost 
as  many,  but  owing  to  the  fact  that  the  last  set  of  samples  was 
not  collected  in  one  of  the  cities,  the  number  whose  progress 
could  be  measured  was  533. 

5.     Cooperators.     All  who  cooperated  with  the  writer  in 
making  the  ratings  were  students  of  Education1.    Two  of  them 
were  men  of  experience  in  school  work.     One  of  them  had  had 
seven  years'  experience  as  a  teacher,  two  years  as  a  school  super- 
intendent, and  had  done  two  years  of  graduate  work  in  Education. 
All  of  these  men  discussed  the  form  before  using  it  in  rating, 
making  sure  that  the  items  would  be  consistently  interpreted  in 
the  investigation.     It  was  therefore  not  necessary  to  depend  at 
all  on  written  instructions. 

!j.  H.  Hanger,  Assistant  in  Education,  University  of  Illinois 
G.  W.  Marshall,  Student  in  Education,  University  of  Illinois 
C.  B.  May,  Student  in  Education,  University  of  Illinois 
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CHAPTER  V. 
THE  DATA 

The  data  gathered  concerning  each  teacher  are  presented 
in  the  following  tables. 

The  figures  under  the  column  of  average  ratings  for 
each  teacher  represent  the  average  of  all  of  the  ratings  on  all 
of  the  items.    The  first  number  under  "supt's  rating"  represents 
the  superintendent's  last  rating  (on  a  scale  of  1  to  10):  the 
second  number  represents  his  first  rating  (on  a  scale  of  1  to  5). 
Under  the  last  two  columns  at  the  right  are  shown  the  gains  and 
losses  in  arithmetic  and  handwriting,  respectively.  Under 
"Arith."  the  first  figures  in  each  case  are  for  addition;  the 
second,  for  subtration;  the  third,  for  multiplication;  and  the 
last  for  division.    Under  "handwr."  is  shown  the  per  cent  of 
pupils  gaining,  minus  the  per  cent  losing  where  the  gain  is 
greater  than  the  loss,  and  the  per  cent  losing  minus  the  per 
cent  gaining  where  the  loss  is  greater  than  the  gain.  is 
always  to  be  understood  as  indicating  a  loss. 


SCHOOL  H 


Teacher  I_ 
Items  Ratings 

1  2-2-2-2 

2  3-2-3-1 

3  —2-3-2-3 

4  — 3-3-2-2 
5  3—2 

6  — 2-3 — l 

7  — 3-3-2-2- 
g  2-3-2-1 

9  1 

10  4 — l 


Teacher  I£ 

1.  —2-2-2-2 
2  2-2-2-2 

3  — 2-4-2-4 

4  — 2-2-3-3 

5  2—3 

6  2-2  2 

7  2-2-3-2 

6  1-2-2-2 

9  2-2  2 


Teacher  III 
1  —2-2-2-3 
2  2-2-2-3 

3  —2-3-2-3 

4  — 2-2-3-4 

5  —2-3—4 

6  — 2-3-2-4 

7  —2-3-2-3 
g  2-2-2-3 

9  — 3-  — 
10  4 — 4 


Teacher  IV 
1  —2-4-2-4 

2  2-2-2-3 

 2-3-2-3 

—2-4  3 

5  —2.4 — 3 

6  —4-2-4 

7  — 2-3-2-3 
g  2-3-2-4 

 2  4 

10 — 2-4 — 5 


Av. 

2. 

2.2 

2.5 

2.5 

2.3 

2 

2.5 

2. 

1. 

2.2 


2. 
2  . 

3- 

2.5 

2.5 

2. 

2.2 

1.2 

2. 

JSai 
2.2 


2.2 

2.2 

2.5 

2.7 

3. 

2.7 

2.5 

2.2 

3. 

4. 

2.7 


3. 
2.2 

2.5 

3. 

3- 

3.3 

2.5 

2.7 

3. 

2.6 


Supt's 
Rating 


1  1 
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City  B 
Training  Experience 


Grade 

Taught 


Normal 
Training 


B. 
13 


total 
21 


Salary    Arith.  Handwr. 


75 


2  2 


Normal 
Grad. 


10 


65 


2  2 


Normal  1 
Training 


57.50 


*  3 


Normal 
Grad. 


55 
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SCHOOL  K 


Teacher  1 
Items  Fating 


1  2-3  

2  —3-3.-.. 

„U — 

— 4-4  


I 

5 

6 

7 

8 

9 

10 


— 4-4  

 4  

—4-3  

..-3.4  


Teacher  III 

1  2-2  

2  3-2  

3  —2-2  

5  4  

7  3.2  

g  2-3  

9  — 4-4  

10  4— 


Teacher  IV 

1  — 4-4—7" 

2  — 3-4  

3  —2-3—- 

4  — 4-3 — - 

5  3— 

6  4-2  

7  —3.4  

I  —4-3-— 

9  

10 —  4-4— 


Av. 

4. 
4. 
3.5 

3- 9 

Jki. 
3.7 


Teacher  £1 

1  2-2   2. 

2  2-2   2. 

3 "!:!::::  * 

5  2   2. 

6  — 2   2. 

7  2-2   2. 

g  —  3—  3. 

9  3   3. 

10  4-2   Jk. 


2.3 


2. 

2.5 

2. 

4. 

4. 

4. 

2.5 

2.5 
4. 

4. 

3.2 


4, 

3.5 

2.5 

3.5 

3. 

3. 

2.5 

3.5 

4. 


Supt »  B 

Rating 


3  3 


City  B 


Training  Experience 


Grade 

Taught 


Univ.  4 
Normal 
Grad. 


B. 

6 


total 

8 


Salary    Arith.  Handwr. 


65 


1  1 


Normal  1 
Grad. 


60 


.1.4 
.4 

1.6 
.2 


-8# 


3  2 


Normal 
Grad. 


57.50 


-  .8 

3. 
1. 

3. 


-6* 


2  1 


Normal  7 
Grad. 


15 


5 
& 

6 


65 


2. 

2.4 

3.8 

2«S 


-25# 
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SCHOOL  K  (Cont'd) 
Teacher  V 


City  B 


Items  Patincr 

Av. 

WUiVt  0 

i  raining 

net,  v  XXI K 

1  2-2 

2. 

2  2-2 

2. 

3  2-2 

2. 

4  1-2 

1.5 

2  1 

Normal 

*5  —2-2 

fl— a  A 

6  2-2 

7  2-2 

2.5 

8  4-2 

1.5 

Q  4-3 

3.5 

10 — 1-3 

2. 

Teacher  VI 

1  2 

2. 

2  —2 

p. 

3  — 
1-1 

■z 
J* 

2 

1  1 

Normal 

5  —2 

2. 

Training 

6  —2 

2. 

f  —2 

2« 

8  2 

2. 

9  —2 

2. 

10  2 

2. 

2.1 

Experience 
B.  total 


Grade 
Taught 


Salary    Arith.  Handwr. 


90 


4.2 
-4.2 
-3.6 
-3.2 


II  23 


65 


Teacher  VII 
1  —2 
2  2 

i  ~i 

7  2 

8  2 

9  —4 
10 — 3 


Teacher  VIII 


2. 

2. 
3- 
3- 
3- 
3- 

2. 
2. 
4. 

2.7 


2  2 


Normal 
Training 


10 


2 
& 
3 


6o 


1  —3-2 

2.5 

2  3-2 

2.5 

3  —  3-* 

3-5 

4  — 4-3 

3.5     2  1 

Normal 

5  —3-2 

2.5 

College 

6  —3-2 

2.5 

Grad. 

7  — 3-3 

3. 

8  3-2 

2.5 

9  —4-2 

3. 

10 — 4-3 

3.5 
2.9 

57.50 
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SCHOOL  &  £ont»d) 

City  B 

Teacher  IX 

Items  Rating 

Av. 

Supt ' 8 

Training  Experience 

Grade 

Salary 

Arith. 

1  IW44  UTf  4" 

Rating 

B.  total 

Taueht 

1  —2 

2. 

2  —-2 

2, 

J :ri 

t 

2  1 

Normal       1  4 

1 

60 

5  — 3 

Grad. 

6  — 4 

7  — 3 

3. 

6  -~S 

9  — 4 

4. 

10 — 4 

4. 

3»3 

Teacher  X 

1  —1-2 

1.5 

2  —2-2 

2. 

3  2-2 

2. 

4  — 2-2 

2. 

3  2 

Normal     11  18 

5 

65 

-.4 

5  -  2-2 

2. 

Training 

2.6 

6  — 2-3 

2.5 

-.8 

7  2-2 

2. 

-.4 

8  2-3 

2.5 

9  — 3.3 

10  2-4 

3. 

2.  3 

SCHOOL  L 

City  B 

Teacher  I 

Av. 

Supt » 8 

Training  Experience 

Grade 

Salary 

Arith. 

Handwr. 

Items  Rating 

Rating 

B.  total 

Taught 

1  —-2-2 

2. 

2  2-2 

2. 

3  2-2 

2. 

4  —2- 3 
—  —  &— j 

2.5 

1  1 

Normal       1  7 

5 

60 

1.2 

5  -2- "3 

2.  5 

Training 

-2.4 

6  ■  2-1 

2.  5 

-2.4 

7  —2-2 

2. 

2.2 

o    — —    &—  ^ 

2.5 

q  -2-3 

2.5 

10  2-4 

2.5 

w  e  • 

Teacher  II 

1  ---3-4 

3.5 

2  — 4-3 

3.5 

3  — 3-3 

3, 

4  4-2 

3. 

4  2 

Normal       4  8 

4 

60 

> 

Training 

6  — 4-2 

3- 

7  -~3-1+ 

3.5 

8  —4-2 

3. 

9  —4 

4. 

10—4-2 

3.3 

SCHOOL  T.  (Cont'd) 
Teacher 


City  B 


Items  Ratine- 

Av. 

Sunt • & 

1  — 3-4 
—  ✓ 

3.5 

2  —.3-2 

2.5 

3  ..-2-3 

2.5 

4  — 2-3 

2.5 

2  2 

Normal 

5  — 3-3 

3. 

Grad. 

6  2-2 

2. 

7  2-2 

2. 

8  2-2 

2. 

9  — 3~ 

3- 

10  2— 

2. 

Experience 
B.  total 


Grade 

Taught 


Salary    Arith.  Handwr. 


57-50 


Teacher  IV 

— 2-3 

 3-3 

 3-3 

:::U 

— 3-2 

— 3-3 

—3-3 
—3-4 


i 
2 

I 

7 
8 

9 

10 — 4-4 


Teacher 

 2-3 

 2-2 

 2-4 

 2-4 

 2-3 

— 2-3 
— 2-3 


10 — 3-4 

Teacher  VI 

1  —4-4 

2  —3-3 

3  —3-4 

4  — 4-3 

5  — 4-4 

6  5-4 

7  —3-3 

8  —3-4 

10— E-^ 


2.5 

2.5 

3. 

3. 

£ 

2.5 

3. 

3. 

11 

3.2 

2.5 

2. 

3. 

3. 

3. 

3. 

2.5 

2.5 

2.5 

2.8 

4. 

3. 

3.5 

3.5 
4. 

4.5 

3. 

3.5 

4. 

4. 

3.7 


1  1 


2  1 


I  1 


Normal  & 
College 

Training 


15  15 


90 


.4 


5* 


Normal 
Training 


21 


21 


65 


64$ 


Normal 
Grad. 


11 


65 


1 
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SCHOOL  L  (Cont'd) 

City  B 

Teacher  VII 

Items  Rating 

Av. 

Supt 1 s 

Training  Experience 

Grade 

Salary 

Arith. 

Handwr. 

l  — 3-^ 

Rating 

B  total 

Taught 

3.5 

2  —3-3 

3- 

3  —2-3 

2.5 

4  —2-3 

2-5 

2 

2 

Normal        1  7 

5 

57.50 

3 

-4$ 

& 

* 

3*8 

6  — 3-3 

2. 

College 

6 

-3  .2 

7  — 3-3 

3. 

Training 

1.4 

8  — 2-3 

2.5 

9  —3-3 

3. 

10 — 3-2 

■  2.5 

2.8 

SCHOOL  W 

City  B 

Teacher  I 

Items  Rating 

1  — 4-3-4-3 

3-5 

2  2-2-3-3 

2.5 

3  4-3-2-2 

2.6 

4  — 2-3-3-4 

3. 

1 

1 

Normal       4  7 

4 

65 

-2. 

46# 

5  —2—3-3 

2.7 

Grad. 

-2. 

6  — 2-2-3-3 

2.5 

-3.6 

7  2-2-2 

2. 

-.  6 

g  2-2-3-3 

2.5 

9  — 2-2-3 

2.3 

10 — 1-2-3-4 

2.5 

2.6 

Teacher  II 

1  2-2-2-3 

2.2 

2  2-2-1-3 

2. 

3  2-2-2-3 

2.2 

4  —2-3-3-4 

3- 

1 

1 

Normal      10  18 

1 

65 

5  — 2-3 — 4 

3- 

Training 

6  — 2-3-3-4 

3- 

7  —3-3.2-2 

2.5 

g  2  2-3 

2.3 

9  3-3-4 

3.3 

10—1—4-4 

3. 

2.7 

Teacher  III 

1  —2-1-2-1 

1.5 

2  2-2-2-1 

1.7 

3  — 3-3-2-2 

2.5 

4  2-2—2 

2. 

1 

1 

Normal       3  10 

3 

57.50 

14  £ 

5  2-1—2 

1.7 

Training 

A 

6  2-1-2-2 

1.7 

4 

7  2-1  2 

1.7 

S  2-1  2 

1.7 

9  —2-1  2 

1.7 

10—2-1—2 

1.7 

1.8 
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SCHOOL  E  (Cont'd) 


Teacher  IV 
Items  Eatings 

1  ...3.2-2-3 

2  — 3-3-3-3 

3  — 4-4-2-2 

4  —4-3-3 

5  —4-3.3-3 

6  — 4-2-3 

7  — 4-3-3-3 

8  —4-3-3 

9  — 4-3-3 
10—4-3-3-2 

Teacher  V 
1  — 1-3-3-3 

2  2-3-3-2 

 2-3  2 

 2-2-3-3 

5  2-2  3 

6  — 2-2-3-3 

7  — 2-3-3-3 

8  2-3-3-2 

9  — 2-3-3-3 
10 — 2-2-3-2 

Teacher  VI 

1  —2-2-2-2 

2  3-2-2-2 

3  3-2-2-2 

4  — 2-3-3-3 
5  2-2-3-2 

6  — 2-2-3-3 

7  — 3-2-1-2 

8  2-2-3 

9  2 

10  2—3-2 

Teacher  VII 
1  2-4-3-3 

2  — 2-3-3-3 

3  — 3-3-2-2 

4  — 2-3-4-4 
5  3-4-3 

6  — 2-3-U-3 

7  — 2-3-^-3 

8  — 3-3-^-3 

9  * 

10  4— -4 


Av. 

2.5 
3. 

3 

3.3 
3.2 

3. 
3.2 

3.3 
3.3 

3.1 

2.5 
2.5 
2.3 
2.5 
2.3 
2.5 
2.7 
2.5 
2.7 
2.2 

2.5 

2. 

2,2 

2.2 

2.7 

2.2 

2.5 
2. 

2.2 

2. 

_2.2_ 
2.2 

3. 
2.7 
2.5 
3.2 

3.3 

3. 

3. 

4. 
3.2 


Supt ' 8 

Rating 


3  2 


Training 


Normal 
Training 


City  B 

Experience 
B  total 


11  18 


Grade 
Taught 


Salary    Arith.  Handwr* 


65 


3 


Normal 
& 

College 

Training 


57.50 


-1. 
4.4 
5.8 
5.8 


7% 


3  2 


Normal 
Grad. 


90 


2.2 
-4, 

0. 


-9* 


3  2 


Normal 
Training 


19 


62. 50 


-72- 


SCHOOL  I  (Cont'd) 
Teacher  VIII 


Items  Ratings 

Av. 

1 

— 3-2-2-3 

2.5 

2 

 2-2-2-2 

2. 

I 

 3-2-2-2 

2.2 

—3-3-2-3 

2.5 

5 

—3-3-3-3 

3. 

6 

— 4-3-3-3 

3*2 

7 

— 3-3-5-2 

3*2 

8 

— 3-3-2-3 

2.7 

3 

3*5 

10  4-4—3 

2.7 

2.9 

Teacher  IX 

1 

—2-2-2-2 

2. 

2 

 2-3-2-2 

o  o 

C  •  C. 

I 

 2-3-2-2 

2.  2 

 1-2 

1.5 

5 

 2.2 

2. 

6 

 1*2 

2.5 

7 

—3-3 — 3 

3- 

8 

 2-2 

2. 

9 

 3-2 

2.5 

1C 

,  2-3 

2.5 

2.1 

Supt 1 e 
Rating 


2  2 


Training 


City  6 

Experience 
B.  total 


Normal 

& 

College 
Training 


13 


Grade 

Taught 


5 
& 

6 


Salary    Arith.  Handwr. 


62,50 


-1. 

1. 
-1.2 

.2 


2  1 


Normal 
Training 


60 


SCHOOL  A 

Teacher  I 
Items  Ratings 

1  4-2  3. 

2  2-1  1.5 

3  2-2  2. 

4   2    3  Normal 

5  2  2.  Training 

6  —3  3- 

7  2-2  2. 

g  2-2  2 

9  4  4. 

10 —  2-3  2.5 

2.5 

Teacher  II 

1  3-2  2.5 

2  3-2  2.5 

3  — 3-2  2.5 

4   4-2  3-        2    3  High 

5  —4-2  3.  School 

6  — -4-2  3.  Training 

7  3-1  2. 

8  4-2  3* 

9  — 5  5- 

10  4-2  _J.  


City  P 
P.  total 


11 


19 


70 


.2 
•  3 


10 


14 


70 


.1.1 

4.4 

•  5 
1.4 


-73- 


SCHOOL  4 

Teacher  III 
I tern 8  Ratings 


1  - 

2  - 

?  - 
4  -. 

?: 

7  - 

8  - 

9  - 
10- 


-2-2 
-2-2 
-3-2 
-2-2 

-3-2 

-3-2 

-2-3 

-3-2 

 1+ 

-4-2 


Teacher  IV 

1  1.2-2  " 

2  2-2-2 

3  —2-3-2 
I  — 2-3-3 

5  —3-3-2 

6  2-2-2 

7  2-4-2 

g  2—3 

9  2  4 

10  2 

Teacher  V 

1  1.2 

2  3-2 

—3-3 
 3 

5  

6  —3-2 

7  — 3-2 

8  3-2 

9  —4 
10 — 4 

Teacher  VI 

1  2-1 

2—  3-1 

3  —3-2 

4  —3 

5  —3 

6  — 4-3 

7  — 2-3 

8  — 3 

9  — 5-3 

10 — 4 


Av. 

2. 
2, 

2.5 
2. 

2.5 

2.5 
2.5 
2.5 
4. 

2.6 

1.7 
2. 

2.3 
2.7 
2.7 

2. 
2.7 

2.5 

3. 

2. 

"iX 

1.5 
2.5 
3- 
3- 

2.5 

2.5 

2.5 
4. 

4. 

2.8 

1.5 

2. 
2.5 

3. 

3- 

3.5 

2.5 

3- 

4. 

4. 
2.9 


Supt'e 
Rating 


3  2 


City  P 

Training    Experience  Grade 
P.     total  Taught 


Normal 
Training 

& 

Univ. 
Grad. 


Salary    Arith.  Handwr. 


65 


1.3 
2. 

•  7 
-1.6 


1  1 


Univ. 
Grad. 


55 


1.2 
1.5 
•7 
-.2 


3  3 


Univ. 
Grad. 


60 


-.4 

-9 
l.s 

•  5 


2  1 


Univ. 
& 

Normal 
Grad. 


11 


80 


-74. 

SCHOOL  A  (Cont'd) 

oixy 

Teacher  VII 

Items    Eat  in  e"6 

Av. 

Sutst  •  & 

J- r«iAJi.ing  rixperienco 

Grade 

•■.■alary    Arixn.  nanuwr. 

nax lag 

r.  total 

Taugnt 

1    —  2-1 

1  R 

C    ———A— A 

i 

7  p_p 

p 

u  3 

> 

2  2 

9 

cy 

R   _  7 

Training 

£  p 

O 
Cm 

7           9  1 
/  £-1 

i»5 

8  

2.5 

Q  7_p 

2  R 

10-  3 

3. 

2.5 

Teacher  VII 

1 

p 

5 

1  1 

Univ.       9  21 

1 

70 

5 
6 

Training 

7 
i 

K 
O 

q 

10 

SCHOOL  B 

Llty  r 

x  v  ecus    nax  in  g  8 

1  ... .1-P.7 
x  

P  7 

2  ...4. ^.R 

h 

3  3.4.4 

4  — 3.3-K 

7  7 

1  1 

normal      id  ±j 

e 
o 

<S0 

R  „.7_7„7 

uraa. 

£  k  U 

4 

7  7  U 

7  R 

PI  — 4.4.R 

4  3 

Q  —.3-3 

7, 
J* 

10  4-4-3 

3.7 

7  6 

i  —  1-1-2 

1.  3 

2  2-1-2 

1.7 

>       j  j 

2.  7 

4  4-4-3 

3.7 

9  7 

Hi  crV\              17  PR 

c 
o 

KR 

5  — 4.4.3 

3.7 

6  — 4-4-3 

3.7 

Grad. 

7  2-2-2 

2. 

*  — 3-3-3 

3. 

9  — 3.2.3 

2.7 

10 — 4.3.4 

_k.Z_ 

2.8 

-75- 


SCHOOL  B  (Cont'd) 

Teacher  III 
Items     Ratings  Av. 


SCHOOL  C 


Teacher  I 

Items  Ratings 

1  2-? 

2. 

2  2-1 

1.5 

3  —3-2 

4  — 3-2 

2.5 

2.5 

5  —3-2 

2.5 

6  2-1 

1.5 

7  2-1 

1.5 

8  —2-1 

1.5 

S  2-1 

1.5 

10 — 3-3 

2. 

City  P 


Supt's  Training 
Rating 


1  1.2-2 

1.7 

P  —  P-7-? 

P  7 

1           7  7k 

3*3 

— 3-*-3 

■J  7, 

3*3 

r       7  11  o 

7 

3« 

O    — — — JJ— •»— <: 

7 
> 

7  — P-7-P 

P  7 

7 

J* 

q  k_k 

k 

10---4-7-4 

7  7 
7 

1  2-3-2 

2.3 

P  '  1  -  Q  . 

c   — A— c— ^ 

c« 

7  —  7-7-7 

7 

J» 

k  U 

7  ^  1 

C    --7-7 

7 
> 

i  2-3 

P  f> 

7  —  P-P-7 

P  7. 
<=•  J 

a  o_"z 

q      — -7-k 

7  d 

ir>— -5-U-7 

7 

-Ja — 

£•  O 

Teacher  V 

1  —2-3 

2.5 

p  _  it 

o 

e« 

7  —2-3 
4  2-3 

2.5 

2.5 

5  —2-3 

2.5 

6  —2-3 

2.5 

7  —2-3 

2.5 

8  —2-3 

2.5 

Q  4 

4. 

10  4-4 

4. 

2.8 

2  3 


High 
School 
Training 


Experience 
P.  total 


14  18 


Grade 
Taught 


Salary    Arith.  Handwr. 


85 


Uhiv. 
Training 


25 


100 


2  2 


Univ. 
Training 


13  15 


80 


City  P 


2  2 


High  1 
School 
Training 


55 


-76- 

SCHOOL  C  (Cont'd) 

fM  +v  P 
vl  wy  r 

Teacher  II 

I teas  Ratings 

Av. 

SuptJs 

Traininc    T1*-t)«t,4  am^a 

P         +  A+nl 

r.  (vvax 

Tail  crh  + 

Sal «  r*v 

A  r  i  th.»     Handwr « 

1  2-1 

1.5 

2  2-1 

1.5 

3  — 3-3 

3. 

4  2 

2. 

2  2 

Univ.        2  20 

4 

70 

-.1 

5  2 

2. 

T  T*ft  IK^TlO' 

1.  3 

6  2 

2. 

•  ./ 

7  2-2 

2. 

2. 

g  2 

2, 

9  

. 

io  3 

3. 

2.1 

Teacher  III 

1  — 2-2 

2. 

2  — 2-2 

2 

3  —  3-* 

3.5 

4  3 

3. 

1  2 

Normal        ^  1"? 

1 

70 

5  3 

3. 

6  2 

2. 

7  —2-3 

2.5 

6  2 

2. 

9  — 3-* 

3.5 

10  4 

4. 
2.8 

Teacher  IV 

1  -..3.3 

3. 

2.  2-2 

2. 

3  — 3-2 

2.5 

60 

4  2-3 

2.5 

1  1 

High         3  9 

3 

5  —3-2 

2.5 

School 

0  — e— e 

c. 

Training- 

7  2-2 

2. 

8  1 

1. 

9  2-2 

2. 

10  1 

1. 
2.1 

SCHOOL  G 

City  P 

Teacher  I 

Items  Ratings 

1  — 3-1 

2. 

2  — 3-1 

2. 

3  -~3-3 

3- 

55 

✓  ✓ 

-.4 

4  4-4 

4. 

1  1 

High        1  8 

7 

1 

5  — 4-3 

3.5 

School 

•7 

6  — 3-3 

7  —3-2 

3. 
2.5 

Grad. 

0.0 
2.4 

g  — 2-3 

2.5 

9  4-4 

4. 

10 — 4-4 

4. 

3.3- 

SSEPQL.  £  (Cont'd) 


Teacher  I£ 
Items  Ratings 


Av. 


1  3-2 

2.5 

2  2-2 

2, 

3  —3-3 

3. 

4  -  3-3 

3. 

r  —3-3 

3. 

6  — -3-2 
>  — 

2.5 

7  — 3-3 

3. 

8  3-2 

2.* 

Q  7 

■z 

10—— 

P  7 
"  f 

Teacher  I£I 

1  —2-2-2 

2. 

2  2-2-2 

2. 

3  3-3-3 

3. 

6  —  ti-3 

3*7 

r  —4-4-3 

3-7 

6  —-3-3-3 

7  —4-4-2 

3.  3 

8  4*.4-4 

2: 

9  w-U 

4. 

10 — 4-4-4 

4. 
3.  3 

Teacher  IV 

1  — 3-2 

2.5 
—■ «/ 

2  —2-2 
t;  3-3 

3. 

»  • 

5  -  3-U 

J*  J 

6  3-4 

7  3-3 

3. 

8  3-4  - 

3.5 

9  — 3 

3, 

10—4-5 

4.5 
3.3 

Teacher  V 

1  -ZTIu2 

3. 

2  3-2 

2.5 

3  — 4-4 

4. 

4  — 4-2 

3- 

5  —4 

4. 

6  — 4-2 

3- 

7  — 3-2 

2.5 

8  3-2 

2.5 

9  —3 

3- 

10—4-3 

3-1 

-77- 


Supt'e 
Rating 


2  2 


City  P 
Training 


Experience 
P.  total 


Normal 
Grad. 


Grade 

Taught 


5 

ft 
6 


Salary    Arith.  Handwr. 


55 


2  1 


Normal 
Training 


10 


60 


•5 
3- 
-.6 

-5 


2  2 


Normal 
Grad. 


55 


1.4 
2.3 


1  1 


Normal 
Training 


18 


65 


-.8 

1.3 

1. 

1. 


-78- 


SCJPJ&.  G  (Cont»d) 


Teacher  V£ 
Items  Ratings 


Av. 


 3-2 

— 3-3 
— 3-3 
— k 

~u 

—3-3 
— 3 
—3-^ 


10  2 

Teacher 

1  —3-2 

2  2-2 

X  2-2 

U  2 

5  «•-•— 2 
6  2 

6  3 

7  2-2 

8  2 

5  

io  3 


VII 


Teacher  VJII 
1  —2-3 
|  2-2 

—3-3 
 3 

5  3 

6  3 

— 2-3 

5  —3-3 

 3 

10  k 


SCHOOL  E. 


2.3 

2.5 
2. 

3. 

3. 

3. 

3. 

2.5 

3. 

3- 

2.9 


Teacher  I 

Items  Eatings 

1  2-2-3-1 

2. 

2  2-2-2-1 

1.7 

J  2-2-3-2 

2.2 

4  2-2-2-1 

1.7 

5  2-2-2-2 

2. 

6  —2-2-2-1 

1.7 

7  —2-2-2-2 

2. 

B  2-2-2-1 

1.7 

o  2-2-2-2 

10  2-2-2-1 

2. 

Supt ♦ 8 

Rating 


2  3 


City  P 
Training 


Experience 
P.  total 


Normal 
Training 


Grade 
Taught 


1 

& 
2 


Salary    Arith.  Handwr. 


55 


1  1 


Normal 
Training 


26 


70 


1  1 


Normal 
Grad. 


18 


20 


85 


-5 
2. 

1.7 
3. 


City  P 


1  1 


High 
TraSnSng 


1 

& 
2 


60 


-79- 


SCHOOL  H  (Cont'd) 


Teacher  II 
Items  Ratings 


 3-2 

 2-2 

:::U 
::±l 

— 3-2 


10 — 4-4 


III 


Teacher 

i  -im:r~ 

2  2-? 

— 3-3 
— 4 

5  —3 

6  ™3-3 

7  —3-? 

8  — 3-2 

9  U-3 

10 —  4-4 


Teacher  IV 

1  —4-3 

2  —3-3 

J 

5  —^-3 

6  — 4-4 

7  — 3-1* 

8  — 3-4 

9  — 4.4 
10 — 4-4 


SCHOOL  K 


Av. 

2.5 
2. 

3. 
4. 

2.5 
3.5 
4. 

3.3 

2.5 
2. 

£ 

3. 

3. 

2.5 

2.5 

3-5 

4. 

3- 

3-5 
3- 
3- 
3-5 

2:5 

3.5 
3-5 
4. 

j+.  

3.6 


Supt  »  8 

Rating 


2  4 


City  P 
Training 


Normal 
Training 


Experience 
P.  total 


11 


Grade 
Taught 


4 
& 
5 


Salary    Arith.  Handwr. 


55 


2.4 
1.2 
-.1 
-3 


2  2 


High 
School 
Training 


2 
3 


60 


1. 
1.3 


2  3 


Normal 
Training 


20 


75 


.8 

2.3 
0.0 

•  5 


City  P 


Teacher  X 

1  — 2-2-3-1 

2. 

2  2-2-2-1 

1.7 

3  2-2-3-2 

2.2 

4  2-2-2-1 

1.7      1  1 

5  2-2-2-2 

2. 

6  2-2-2-1 

1.7 

7  2-2-2-2 

2. 

8  2-2-2-1 

1.7 

9  2-2-2-2 

2. 

10  2-2-2-1 

1.9 

Normal 
Grad. 


55 


-80- 


SCH00L  K  (Cont'd) 


Teacher  II 
Items  Ratings 


mm  i 

Teacher  I 
Items  Ratings 

1  2-2 

2  2-3 

3  —2-3 

i+  —3 

5  --2-3 

6  — 3-3 

7  — 2-3 

8  — 3 

9  — 2 
10 — 


Av. 


1 

 2-2-3-1 

2. 

2 

— 3-3-3-2 

2.7 

3 

 2-3-3-3 

2.7 

4 

— 2 — k 

3. 

I 

 u 

5. 

— 2 — 4 

3- 

7 

 2-3-2-2 

2.2 

8 

 3-3-3 

3. 

9 

 2  k 

3. 

4. 

3. 

Teacher  III 

1 

 2-2-3-2 

2.2 

2 

 3-2-2-2 

2.2 

u3 

 2-2-3-3 

2.5 

 2-2-U-3 

2.7 

5 

 4-3 

3.5 

6 

— 3 — lug 

3. 

7 

 2-2-2-2 

2. 

8 

 3-3 

3. 

9 

—2—3-3 

2.7 

10— -2 — 3-3 

2«7_ 

2.7 

Teacher  IV 

l 

 2-2-2-2 

2. 

2 

 2-2-3-2 

2.2 

—2-2-3-3 

2.5 

 2-2-2-2 

2. 

5 

 2-2-2-2 

2. 

6 

 2  2-2 

2. 

7 

 2-2-3-2 

2.2 

8 

 2  1-2 

1.7 

9 

—2 — 3-3 

2.7 

10 

 3-2 

2.5 

2.2 

2. 

2.5 

2.5 

3- 

2.5 

3. 

3- 

3. 

2 

Iff" 


Supt • e 
Rating 


City  P 
Training 


Normal 
Grad. 


Experience 
P.  total 


20 


Grade 
Taught 


Salary    Arith.  Handwr. 


60 


2  3 


Normal 
Training 


12 


70 


2  3 


Normal 
G-rad. 


55 


2.8 

1-9 

2.5 
0.0 


City  P 


1    3  High 
School 
Training 


60 


2.1 
.3 
•  7 

-.9 


-81- 


SCJPPJ,  I  (Cont'd) 


Teacher  II 
Items  Ratings 


— 3-3 
— 2-3 


I  :::tl 


— 2-4 


7  —2-3 
g  2-4 


9  -~3-* 
10  4 


Teacher 

1  4-2  " 

2  2-2 

 3-2 

 2 

5  —2 

6  2 

7  2-2 

6  2 

9  —3 
10 — 3 

Teacher 

2  —3-3 

3  2-4 

4  3-4 

—5-4 
—5-4 
—3-4 
—3-4 
— 4-4 
10 — 3-4 


III 


IV 


Av. 

3- 

2.5 

2.5 

4. 

3. 

3. 

2.5 

3. 

n 

3.1 

3  • 
2. 

2.5 

2, 

2. 

2. 

2. 

2. 

3. 

3.5 

3. 

3- 

3.5 

5.5 

4.5 

3.5 

3-5 
4. 

3.6 

2.5 
2. 

2.5 
2. 
2. 
2. 

2.5 

2. 

4. 

2.4 


City  P 


Supt • 8 

Rating 


2  2 


Training 


College 

Training 


Experience 
P.  total 


17 


Grade 
Taught 


Salary    Arith,  Handwr. 


65 


2  2 


High 
School 
Training 


11 


16 


82. 50 


2  2 


UniVe 
Brad. 


12 


2 
* 
3 


65 


2  3 


Normal 
Training 


75 


-82- 


SCHOOL  L  (Cont'd) 


Teacher  VI 
Items  Ratings 


Av. 


1  2-2 

2. 

2  2-2 

2, 

^      1 2  3 

11  r— 1  -) 

H  —2-3 

2.5 

2.5 

3. 

6  — 1-3 

2. 

7  — 1-3 

2. 

g  — 1-3 

2. 

q  3 

3. 

Teacher  VII 

1  --3.3 

3. 

2  2-3 

3. 

i  ±r> 

2.5 

3. 

5  — 5 

5- 

6—5 

5. 

7  —3-3 

3- 

8  - 

9  - 
10- 


Teacher  yi££ 

—3-3 
 2-U 

ZS 

 4 

—3-4 

 2-4 

—3-4 
 2 


3.6 


10  2-U 


SCH00J,  M 


3- 
3. 
2.5 

£5 

3-5 
3. 
3.5 
2. 

3-1 


Teacher  ,1 

Items  Ratings 

1  2-1.1 

1.3 

2  *— 2-1-1 

1.3 

3  2-1.2 

1.7 

4  2-1-2 

1.7 

5  2  2 

2. 

6  — 2 — 2 

2. 

7  — 3-1-2 

2. 

3  g.1. 

1.5 

—2 — 2 

2. 

ttO  2-1 

"T7~ 

Supt • 8 

Rating 


1  1 


City 
Training 


Experience 
P.  total 


Univ. 
Grad. 


10 


12 


Grade 

Taught 


1 
& 
2 


Salary    Arith.  Handwr. 


75 


2  2 


High 
School 
Training 


60 


-3 


2  2 


Univ, 
Training 


55 


2.3 


City  P 


3  3 


Univ. 
Grad. 


55 


-83- 


SCHOOL  M  (Cont'd) 


Teacher  IJt 
Items  Ratings 


Av. 


Supt • 8 

Rating 


Training 


City  P 

Experience 
P.  total 


1  3-2 

2.5 

2  2-2 

2. 

3  —2-3 
k  — U-3 

2.5 
3-5 

1 

1 

5  —3-3 

3. 

6  —3-3 

3- 

7  — 2-2 

2, 

8  — 3-3 

3- 

q  — U 

3.5 

10  4-4 

4. 

2-9 

Teacher  III 

1               "7     O  "7 

l  — 3-2-3 

2.7 

2  —  3-1-4 

2.7 

3  — 3-3-3 

3« 

ll                )l      1  ll 

4  ---4-1-4 

3» 

1 

1 

c         h   i  li 
5  4-3-4 

3»7 

0  —  4-—  4 

4. 

7  — 3 — 4 

3.5 

O  11 

8  — 3 — 3 

3« 

ft              ll  *2 

9  —4-3 

3*5 

10—3—4 

^  1 

3»3 

Teacher  IV 

X  — — — c— c 

Ca 

2  —2-3 

2.5 

?  —  f-3 

2.5 

4  4-3 

3.5 

2 

2 

|  3 

3. 

6  —3-3 

3. 

7  —2-3 

2.5 

8  — 3 

2. 

9  4-4 

4. 

10  4-4 

4. 

3 

Teacher  V 

1  3-2-2  ~ 

2.3 

2  3-2-2 

2.3 

3  — 3-3-3 

3. 

4  —2-5-3 

3.3 

1 

1 

5  — 2-3-3 

2.7 

6  —2-3-3 

2.7 

7  —3-3-3 

3. 

8  2-4-3 

3. 

9  — 3-3-3 

3. 

10  3-4-4 

2*9 

Grade 
Taught 


Salary    Aritb.  Handwr. 


Normal 
Training 


Univ. 
Grad. 


20 


60 


3.6 
5. 


High 
School 
Training 


55 


1.5 

2. 
2.7 


College 
Grad, 


5 


65 


SCHOOL  M  (Cont'd) 


Teacher  VI 
Items  Ratings 


Av. 


l  — 3-1-3 

ft  "7 

2.3 

2  — 3-1-3 

ft  *7 

2.3 

T             7    1  1 

3  — 3-3-3 

3* 

4  —4-1-4 

3» 

c              7  k 

3*5 

C         k  7  k 

3.7 

t         k  i  k 
7  —4-1-4 

3* 

of             i  h 
ft          c   ii  n 

10-— 4-H--4 

3*5 
4. 3 

,4. 

30 

Teacher  VII 

^  tot 

1  — 3-2-3 

2.7 

2  —3-2-2 

2.3 

3  — 3-3-H 

3*3 

il               T     ft  *7 

4  — 3-2-3 

2.7 

5  — 2-3-3 

2.7 

6  — 2-3 

2.5 

—j                        ^       ~?  ~7 

7  — 2-3-3 

2.7 

g  —2-3-4 

3» 

ft  *? 

9  —3 

■7 

3. 

1            o  c 

10-— 2—5 

.3?,  5, 

ft  ff 

2.8 

Teacher  VIII 
......   

l  — 4-3 

7  c 

3*5 

2  3-2 

2.5 

3  —4-2 

3. 

4  —4-3 

3.5 

5  —3-4 

3.5 

6  — 4 

4. 

7  — 3-2 

2.5 

6  — 3-3 

3. 

|  —3-3 

3. 

10  4-3 

3.5 
3.2 

SCHOOL  ? 


Teacher  I 

Items  Ratings 

1 

 2-3-2-2-1 

2. 

2 

— 3-3-3-3-2 

2.8 

3 

— 2-3-2-3-3 

2.6 

4 

— 2-4-3-3-4 

3.2 

5 

— 2-4-4-3-4 

3.* 

6 

 4-2-3-3 

3. 

7 

— 2-4-2-3-3 

2.8 

s 

— 3-4-3-2-3 

3. 

Q 

 4—1-3 

2.7 

10 — 3-5 — 3-3 

2*9 
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Supt ♦ 8 

Rating 


1  1 


City  P 
Training 


Univ. 
Training 


Experience 
P,  total 


13  15 


Grade 

Taught 


Salary    Arith.  Handwr. 


75 


1  3 


Normal 
Training 


65 


1  1 


College 
Training 


12 


80 


29  } 
3.* 

3.* 

2.9 


City  P 


2  2 


College 

Training 


60 


0.0 
0.5 


-65- 


SCHOOL  ¥  (Cont'd) 


Teacher  II 
Items  Patinge 

1  2-?-?- 2- 2 

2  2-3-2-2-1 

3  2-?-?- 3- 2 

4  2-3-2-2-2 

5  2-4  4-3 

6  2-3  4-2 

7  2-3-2-2-2 

g  2-2-3-1-2 

9  2-4  2 

10  3  2-2 


4 


Teacher  III 

1  2-3-1-3-3 

2  2-2-2-5-2 

— 2-3-3-3-3 

 2-4-3 

5  4-5-3 

6  — 2-3-U-5-2 

7  —2-3-3-^-3 
g  — ? — 4-5-3 

9  5.3 

10  4-3 

Teacher  IV 

1  2-3-3-3-2 

2  2-3-2-2-2- 

3  2-3-2-3-3 

4  3-3-4-4 

5  4-4-4-4 

6  — 3-4-4-4-4 

7  — 2-3-2-3-2 
g  4-2 — 4 

9  2-4—4-4 

10  4-4 — 4 


Teacher  V 

 2-3^2-2-3 

— 2-2-3-3-3 
.2-2-2-3-1* 


—3-3 — 3-1* 
 4-4-2-4 


1 

2 

3 

4 

5 

6  — 2-4-4-3-4 

7  — 2-2 — 3-3 

g  4 — 4-4 

q  2-4  4-4 

10  4 — 4 


Av. 

2. 

2 

2.2 
2.2 
3.2 

2.7 
2.2 

2. 

2.7 
2. 


City  P 


Supt»e  Training 
Rating 


Experience 
P.  total 


Grade 
Taught 


2  2 


Univ- 
Grad. 


Salary    Arith,  Handwr. 


70 


1  1 


College 
Grad. 


20 


S5 


3  3 


Normal 
Training 
& 

College 
Grad. 


55 


2  2 


High 
School 
Training 


12 


60 


0.3 
-.1 

2.  1 
1.6 


1.6 
1.1 
•  5 


3.2 
1.8 

0-9 
1.7 
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JBCBOOI  W  (Cont'd) 

City  P 

Teacher  VI 

Items    Ratings    Av.    Supt's    Training   Experience    Grade    Salary    Arith.  Handwr. 

Rating  P.    total  Taught 

1  — 3-2.2-3.3  2.6 

2  —3.3-2-5-3  3.2 

3  2-?- 2-3-4  2.6 

4  2-3-2-3-4  3.2     2    3  Univ.      14       Ik  7        82.50  3.1 

5  2  3-4  3.  Grad.  2.2 

6  2-2-2-4-4  2.8  1.6 

7  2-3-1-4-4  2.8  2.3 

8  2-3-2-4-4  3. 

q  3  k  3.5 

10 — 2-2—4-4  3. 


Teacher  VII 

1 

 2-3-3-Ci 

2.8 

2 

— 4-2-3-3-2 

2.8 

3 

— 2-2-2-3-3 

2.4 

4 

—3.3-3-4-2 

3. 

5 

—3—3.4-2 

3. 

6 

 4-4-5-2 

3.7 

7 

 3—4-2 

3. 

8 

— 2  4-2 

2.7 

9 

™3 — 4.3.3 

3.2 

10  3-2 

.  2.5 

2.9 

1    1         Univ.      13       16  2  70 

Grad. 
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CHAPTER  VI. 
CORRELATIONS  AND  INTERPRETATIONS 

Correlations  between  the  progress  of  pupils,  as  meas- 
ured by  the  Courtis  Tests  in  Arithmetic  and  by  the  Thorndike 
Handwriting  Scale  on  the  one  hand,  and  the  average  ratings  of  the 
corresponding  teachers  on  the  rating  form  on  the  other  hand,  have 
been  worked  out1.     In  determining  the  correlation  between  gain 
in  the  four  fundamental  processes  of  arithmetic  and  the  rating 
of  the  teachers  on  the  form,  two  methods  were  used.     In  the  first 
instance  the  correlation  was  determined  on  the  basis  of  the  medi- 
ans of  ratings  on  the  form  and  improvement  of  the  pupils  in  the 
tests1.    Here  the  correlation  is  -.63  (P.E.  0.18). 

By  use  of  the  Court i s  standards  for  achievement  in  these 
tests,  for  each  of  the  grades  III-VIII,  the  improvement  which 
should  be  made  in  each  grade  from  one  year  to  the  next  was  cal- 
culated.    One  fourth  of  this  year's  improvement  was  taken  as  the 
gain  which  might  be  reasonably  expected  during  the  seven  weeks 
between  the  two  tests.    With  this  average  used  as  a  median  the 
correlation  with  the  ratings  of  the  teachers  on  the  form  was  se- 
cured by  the  method  used  in  the  earlier  correlation.    By  this 
method  it  was  found  to  be  0.57  (P.E.  0.18). 

IThe  writer  felt  that~there  wouldlbe  some  variability  between  ~the~ 
accomplishment  of  a  group  of  pupils  at  different  times,  due 
to  accidental  conditions.     He  was  unable  to  get  an  authorita- 
tive statement  on  this  point  either  from  critical  literature 
on  the  subject  or  from  personal  communication  with  the  author 
of  the  tests,  Mr.  S.  A.  Courtis.    He  has  chosen  somewhat  arbi- 
trarily to  disregard  all  gains  and  losses  of  less  than  0.3. 
This  mean3  that  all  differences  of  as  much  as  one  "right"  in 
one  of  the  fundamentals,  or  for  all  four  processes  combined, 
are  used  in  calculating  the  correlations. 
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The  form-ratings  of  the  teachers  in  City  B  show  a 
correlation  of  0.34  (P.E.  0.3)  with  the  ratings  of  these  teachers 
in  General  Teaching  Ability,  by  the  superintendent;  while  the 
form-ratings  of  the  teachers  in  City  P,   show  no  significant  rela- 
tion with  the  superintendent's  ratings.     The  superintendent  of 
City  B  had  used  the  form  in  rating  the  recitations  in  three  of  his 
schools1,  before  making  the  rating  in  General  Teaching  Efficiency, 
while  the  superintendent  of  City  P  had  not  used  the  form  at  all. 
The  superintendent  of  City  B  required  several  hours  to  make  the 
rating  of  his  30  teachers  in  General  Teaching  Ability;  while  the 
superintendent  of  City  P  rated  his  56  teachers  in  less  than  one 
hour. 

The  following  distribution  shows  the  ratings  of  the 
teachers  of  the  two  cities  on  the  form  and  the  ratings  of  the  same 
teachers  by  the  superintendents  in  General  Teaching  Ability: 


Superintendents1  Ratings  Total 

Scale  ratings             12  3  4 
1-1.4 

1.5-1.9                       3        1  3 

2  -2.4  11  6  2  19 
2.5-2.9                      10        11  8  29 

3  -3.4  7  10  7  1  25 
3.5-3.9                        2          2  3  m  6 

32        30  19          1  82 


J- These  ratings  were  to  have  been  included  in  the  study,  but  they 
were  mailed  to  the  writer  by  the  superintendent  during  the 
summer  months  and  were  lost  in  the  mails. 
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Median  on  form  corresponding  to  superintendents*     rating  of  1—2.65 
"      "  "  B  "  «        »  3—2.85 

«  3—2.97 

"  9         "  4—3.20 

Median  of  fourth  group  not  very  significant  (based  on  one  rating). 

The  correlation  between  the  form  ratings  and  the 
superintendents'  ratings  based  on  the  distribution  just  shown  is 
0.32  (P.E.  0.12)1.     While  this  correlation  is  not  very  high,  it  is 
decidedly  positive  and  tends  to  support  the  form  ratings,  when 
considered  in  connection  with  the  high  negative  correlation  between 
the  form-ratings  and  the  Courtis  tests  results. 

The  correlation  between  improvement  in  handwriting  with 
the  form  ratings  was  next  determined.     The  correlation  here  is 
0.60  (P.E.  0.28).     This,  it  will  be  noted,  is  almost  as  strong  ly 
positive  as  the  others  are  negative,  but  the  comparatively  small 
number  of  rooms  (14)  tested,  cause  this  correlation  to  carry  less 
weight  than  the  two  previous  correlations.     The  very  striking 
contrast  here  suggested  a  comparison  of  the  results  in  the  two 
types  of  tests  in  those  rooms  where  both  were  given.     The  correla- 
tion here  was  -0.71  (P.E.  0.36),  but  here  again  the  number  of 
rooms  (10)  in  which  results  in  the  two  types  of  tests  could  be 
compared  was  too  small  to  be  at  all  conclusive. 

1  This  distribution  is  made  from  the  first  ratings  of  the  super in- 
tendents  (the  ratings  which  appear  second  in  the  tables)  in 
which  the  superintendents  rated  the  teachers  into  five  ranks 
or  degrees  of  General  Teaching  Ability,   "1",   "2",   B3n,  n4n 
and  "5".     The  preceding  correlation  between  the  form-ratings 
and  the  ratings  of  the  superintendent  of  City  B  is  based  on 
the  second  ratings  of  the  superintendent  (the  ratings  which 
appear  first  in  the  tables)  in  which  the  superintendents  were 
asked  to  rate  their  teachers  into  ten  ranks  or  degrees  of  Gen- 
eral Teaching  Ability. 
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Theae  figures  show,  of  course,  insofar  as  they  can  be 
considered  representative,  that,  in  general,  where  improvement 
is  marked  in  handwriting  it  is  small  or  absent  in  the  four  arith- 
metical processes,  and  vice  versa  .     The  two  alternatives  in 
explaining  these  results  are  apparently;  First,  that  the  teachers 
who  were  securing  great  improvement  in  either  handwriting  or 
arithmetic  were  stressing  that  subject  to  the  neglect  of  the 
other;  and  second,  that  ability  in  teaching  the  fundamental  arith- 
metical processes  is  negatively  correlated  with  ability  in  teach- 
ing handwriting.     In  the  writer's  opinion,  the  former  explanation 
is  mtrch  the  more  reasonable    of  the  two.     Certain  conditions  in 
these  schools,  in  regard  to  the  arithmetic  teaching,  durine:  the 
interval  between  the  two  testa  will  be  brought  out  in  the  follow- 
ing paragraph,  and  will  throw  some  light  on  this  point. 

The  high  negative  correlation  between  the  improvement 
shown  by  the  Courtis  Tests,  and  the  rating  of  the  teacher  by  the 
judges  might  be  construed  to  mean  that  the  items  on  which  the 
teachers  were  rated  are  not  important  elements  in  teaching.  The 
writer  does  not  believe  that  this  follows  from  the  data.    He  be- 
lieves, on  the  other  hand,  that  the  Courtis  Tests,  in  the  case  of 
these  particular  schools  at  least,  were  not  only  not  good  tests 
on  which  to  base  an  estimate  of  teaching  efficiency,  but  that 
they  might  be  reasonably  expected  to  show  results  quite  misrepre- 
sentative  of  the  actual  work  in  the  rooms.    A  short  time  before 
the  first  tests  were  given  the  teachers  had  begun  the  use  of 
certain  uniform  cards  in  their  arithmetic  work.     On  these  cards 
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were  printed  series  of  figures  consisting  of  examples  in  addition, 
subtraction,  multiplication  and  division.     By  means  of  a  formula, 
the  pupil  could  tell  immediately  whether  or  not  the  work  was  ac- 
curately done.     If  the  example  was  correctly  worked  a  certain 
combination  of  the  figures  in  the  answer  would  always  give  the 
figure  found  in  a  certain  position  of  the  original  series,  e.g., 
the  sura  of  the  last  two  digits  of  the  answer,  minus  the  middle 
digit,  will  be  equal  to  the  first  digit  of  the  original  series. 

These  cards  were  used  by  some  teachers  to  the  practical 
exclusion  of  any  problem  or  original  work.     The  arithmetical  work 
in  the  case  of  these  teachers  became  more  than  ever  a  drill  in  the 
manipulation  of  numbers.    While  this  kind  of  work  would  naturally 
increase  the  specific  ability  which  the  Courtis  Tests  measure, 
it  does  not  by  any  means  follow  that  the  teacher  who  is  able  to 
increase  the  skill  of  her  pupils  in  the  manipulation  of  numbers, 
should  be  ranked  proportionately  high  in  teaching  ability,  if 
teaching  ability  is,  as  the  writer  believes,  rightly  conceived 
and  embbdied  in  the  present  rating- form.     It  seems  to  the  writer 
altogether  likely  that  certain  teachers  who  possessed  no  great 
amount  of  originality  or  initiative  accepted  this  mechanical  device 
and  put  more  than  the  customary  stress  on  this  particular  work 
during  the  period  over  which  the  cards  were  used,  which  happened 
to  cover  the  interval  between  the  writer's  two  tests.     If  this 
was  the  case,  it  is  not  strange  that  the  poor  teachers  should 
make  a  good  record  in  the  Courtis  Tests. 

The  writer  realizes  that  there  are  at  least  two  other 
possible  explanations  of  the  negative  correlation  between  his 
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form  ratings  and  the  Courtis  test  results.     In  the  first  place 
it  may  be  said  that  the  factors  which  the  writer  has  chosen  to 
rate  are  not  the  important  factors  in  teaching  ability.  This 
point  has  been  discussed  earlier  and  will  not  be  treated  in  further 
detail  here. 

Again,   it  may  be  thought  that  the  items  of  the  form 
were  not  interpreted  in  the  same  way  by  all  of  the  persons  rating. 
In  order  to  see,  if  possible,  to  what  extent  this  is  true  the 
correlation  between  the  ratings  of  the  writer  and  those  of  the 
other  judges  was  worked  out1.     This  correlation  is  .46  (P.E. 
-0.048).     While  this  correlation  may  seem  at  first  somewhat  low, 
for  ratings  on  the  same  teachers,  it  is  seen  to  be  reasonably 
high,  when  all  of  the  factors  entering  into  the  ratings  are  con- 
sidered. 

In  the  first  place,  the  judges  rated  different  recitations  . 
There  is,  of  course,  a  chance  for  a  considerable  amount  of  varia- 
tion from  day  to  day;  due  to  the  physical  condition  of  the  teacher 
and  the  pupils,  the  time  of  day  at  which  the  visit  is  made,  etc. 
Another  factor  which  tends  to  produce  some  variability  is  the 
subject  of  the  recitation.     Some  teacbers  show  much  more  teaching: 

w 

ability  in  certain  subjects  than  in  others. 

Considering  the  above  factors  which  tand  to  produce 
variability  in  ratings  by  any  scale  or  form,  the  correlation  of 
0.46  is  reasonably  high. 

The  Courtis  Tests,  like  many  other  tests  that  have  been 
devised  for  use  in  elementary  school  work,  measure  a  very  specific 

^Correlation  determined  by  the  Spearman  "footrule  for  correlation". 
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and  a  very  necessary  ability  of  the  child,  but  it  can  hardly 
be  claimed  that  they  furnish  anything  like  an  adequate  basis  on 
which  to  judge  teaching  ability.     The  following  quotation  sounds 
a  note  of  warning  against  rash  interpretations  of  the  results 
of  such  tests,  and  expresses  well  the  attitude  of  the  present 
writer: 

"While  the  ideal  of  scientific  or  exact  measurement 
is  greatly  to  be  commended,  there  is  grave  danger  that  the 
weighting  and  measuring  apparatus  may  not  be  as  scientifically 
correct  as  they  should  be,  and  that  they  may  be  used  in  ways  for 

which  they  were  not  intended.  .     Certain  results 

of  instruction  can  be  measured,  as,  for  example,  the  degree  of 
legibility  of  handwriting,  when  matched  with  the  corresponding 
sample  on  the  Ayres  scale;  or  accuracy  and  speed  in  adding  or 
subtracting  numbers  when  tried  by  the  Courtis  test.     These  stand- 
ards help  us  to  know  a  great  deal  more  exactly  than  we  can  know 
without  their  aid  the  value  of  the  results  which  we  are  getting 
in  terms  of  the  standard.     Put  there  are  very  important  features 
of  the  learning  process  which  they  do  not  measure  and  do  not 
attempt  to  measure.     One  of  these  is  the  interest  which  students 
take  in  the  process  which  they  are  acquiring;  another  is  the 
value  which  they  are  learning  to  attach  to  it;  a  third  is  the 
obstacles  which  they  are  overcoming;  and  a  fourth,  the  degree  of 
momentum  with  which  they  are  likely  to  carry  these  processes  on 
after  leaving  school"1. 

As  this  author  points  out,  the  present  scales  and  tests 

enable  one  to  det ermine .  J^a^j^aultejar e  belng_  ac compl i sh ed  " in 

1Er^!liK£^TS^i?oore"L,^at  ,isA3ucaUctfl",Pp,S99-3Q0.See  alsoTf  .F~/  N 
.  rearborn:The  Misuse  of  Standard  Tes£ s  in  S&catTon.   School  and  (Cent.  ) 
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terms  of  the  Standard".     These  results  are  important  and  it  is 
well  to  secure  them,  but  he  recognizes  that  there  are  other  phases 
of  teaching  for  which  we  have,  as  yet,  no  scales  or  purely  objec- 
tive tests. 

In  order  to  secure  a  further  check  upon  the  ratings 
on  the  form,  the  ratings  of  the  superintendents  upon  the  teachers 
in  those  rooms  where  the  Courtis  Tests  were  given,  were  compared 
with  the  improvement  of  the  pupils  in  those  rooms.     The  correlation 
shown  here  is  -0.39  (P.E.  0.18).     While  this  correlation  is  not 
so  high  as  that  between  the  test  results  and  the  ratings  on  the 
form,   it  is  still  decidedly  negative.     The  teaching  ability  of 
those  teachers,  then,  who  advanced  their  pupils  most,  as  measured 
by  successive  tests  in  arithmetic  is,  as  a  rule,  rated  low  by 
the  superintendents  as  well  as  by  persons  using  the  rating  form. 

In  order  to  ascertain  to  what  extent,  if  at  all,  the 
progress  of  the  pupils  in  one  particular  type  of  mental  work  is 
related  to  the  ability  of  the  teacher  in  the  same  work,  the  writer 
applied  the  Courtis  tests  to  56  teachers,  including  those  whose 
pupils  had  been  tested  in  the  same  way.     The  correlation  shown 
here  between  the  accomplishment  of  the  teachers  in  the  tests 
and  the  improvement  of  the  corresponding  pupils  over  a  period  of 
seven  weeks  was  0.62  (P.E.  0.21).     This  correlation  indicates  a 
relation  of  an  intimate  sort  between  the  teacher's  own  ability 
in  the  four  fundamentals  and  her  success  in  advancing  her  pupils 
in  the  same  processes.     To  the  writer,  who  places  a  good  deal  of 
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confidence  in  his  form-ratings,   the  relation  just  shown  seems 
to  lend  support  to  his  tentative  conclusion  that  advancing  pupils 
in  such  specific  work  as  that  of  the  Courtis  tests  does  not  neces- 
sarily indicate  anything  with  regard  to  General  Teaching  Ability. 

The  writer  does  not  believe  that  these  results  should 
be  interpreted  as  meaning  that  ability  to  advance  pupils  in  the 
material  of  the  Courtis  tests  is  negatively  correlated  with  general 
teaching  ability.     It  was  not  necessarily  the  ability  of  the 
teacher  to  teach  the  material , that  was  measured  by  the  tests.  It 
was  simply  the  actual  accomplishment,  regardless  of  the  time  or 
stress  that  may  have  been  put  upon  that  particular  phase  of  the 
school  work.    The  only  safe  inference  to  be  drawnfrom  these  data 
in  this  connection  is  simply  that  results  from  the  Courtis  tests 
alone  can  not  be  understood  to  indicate  corresponding  General 
Teaching  Ability  on  the  part  of  the  teacher  of  the  pupils  to  whom 
the  tests  are  applied. 

The  correlation  between  scale  rating  and  total  teaching 
experience  was  found  to  be  -.46  (P.E.  0.12).     This  negative  cor- 
relation seemed  at  first  quite  inexplicable,  inasmuch  as  good 
teaching  has  been  generally  supposed  to  be  positively  correlated 
with  experience.     In  endeavoring  to  explain  this  apparent  ancraoly 
the  writer  compared  the  experience  of  the  groups  representing 
different  kinds  and  amounts  of  training.     The  experience  of  each 
group  is  indicated  below.     In  each  case  the  first  number  repre- 
sents the  median  and  the  second  number  represents  the  average 
number  of  years'  experience. 
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Number  Experience 

in  group  Av.  Med. 

High  School  Training  only   11  10  9 

High  School  Graduation  only   2  16 

Normal  training  but  not  graduation  —        25  12  10 

University  or  college  training  but 

not  graduation   14  16  15 

University  or  college  graduation   19  10  10 

Normal  graduation   15  6  4 

It  will  be  noted  here  that,  in  general,  the  teachers  who 
have  had  most  experience  are  the  teachers  whose  training  has  been 
limited.     There  seems  to  be  evident  here  the  growing  tendency  for 
teachers  to  prepare  themselves  more  thoroughly  before  beginning 
to  teach.     In  view  of  this  tendency  it  is  only  natural  that  one 
should  find  the  better  teachers  among  those  of  comparatively 
little  experience. 

Ruediger  and  Stray er  concluded  that  teachers  improve 
for  about  ten  years  of  service  and  lose  after  about  the  twenty- 
fifth  year1.     In  connection  with  thfe  point  the  following  distri- 
bution is  interesting.     The  teachers  were  divided  into  five 
groups  on  the  basis  of  number  of  years  of  experience.     The  total 
number  of  teachers  and  the  per  cent  at,  above,  and  below  the 
median  of  the  ratings  are  given  for  each  of  the  five  groups. 


Ruediger  and  Strayer:  Qualities  of  Merit  in  Teachers.  Jr.  of  Ed. 
Psych.  May,  1910.     Vol.  1. 
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in  the  way  that  Ruediger  and  Strayer  did.     For  the  rank  of  the 
teachers  in  the  6-10  year  group  is  better  than  that  of  the 
1-5  year  group,  apparently  showing  that  the  teachers  are  continu- 
ing to  improve.     The  writer  believes,  however,  that  the  training 
of  the  teachers  of  varying  amount  of  experience  must  be  taken 
into  consideration  in  this  connection.     Considering  form-rating 
and  experience  alone  the  above  distribution  would  indicate  that 
teaching  ability  declines  very  decidedly  after  about  ten  years 
of  experience  and  rises  again  after  about  twenty  years  of  exper- 
ience.    Comparatively  few  teachers  in  these  two  school  systems 
have  had  more  than  twenty  years  of  experience,  but  in  their  cases 
there  seems  to  have  been  a  survival  of  the  fittest. 

Ruediger  and  Strayer  in  their  study,  referred  to  above, 
found  that  of  the  teachers  rated  on  their  list  of  items  69$  of 
the  best  teachers  were  in  grades  1,  2,  7  and  8.    More  special 
training  or  at  least  more  highly  specialized  ability  is  required 
of  the  teacher  in  the  first  and  second  grades,  especially  the 
first,  and  the  teachers  in  these  grades  are  generally  supposed  to 
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be  better  teachers  than  those  in  the  intermediate  grades.  Accord- 
ing to  the  ratings  on  the  form  in  the  present  investigation,  this 
is  true  for  these  teachers,  inasmuch  as  63$  of  the  teachers  in 
these  two  grades  are  rated  above  the  median. 
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CHAPTEP  VII. 

USE  OF  THE  RATING  FORM  BY  SUPERINTENDENTS  AND  TEACHERS. 

A.     Extended  Application  of  the  Rating  Form  in  the 
School  Systems  of  Illinois. —    In  order  to  ascertain  whether  the 
form  could  be  used  satisfactorily  by  school  superintendents,  and 
in  order  to  secure  additional  data  on  the  basis  of  which  to  deter- 
mine certain  correlations  suggested  by  the  ratings  of  the  origi- 
nal eighty-six  teachers,  the  writer  requested  the  superintendents 
in  one  hundred  school  systems  of  Illinois  to  rate  all  of  their 
elementary  teachers  upon  the  form. 

Superintendents  of  small  cities  or  towns  were  selected 
to  do  this  rating,  as  it  was  highly  desirable  that  the  ratings 
should  be  made  upon  actual  recitations,  and  it  was  not  thought 
that  the  superintendents  of  the  larger  cities  would,  or  could, 
do  this  sort  of  rating  and  send  in  their  results  within  the  time- 
limits  of  the  present  investigation. 

Certain  modifications  were  made  in  the  wording  of  some 
of  the  items.    The  form  as  shown  herewith,  represents  very  nearly 
what  the  judges  were  rating  in  the  case  of  the  86  teachers  to 
whom  the  form  was  first  applied.     It  was  thought  necessary  to  make 
some  of  the  items  more  explicit,  however,  when  sending  the  forms 
to  the  superintendents.     Particularly  was  this  thought  to  be 
necessary  in  the  case  of  Governmental  Skill,  which  was  intended 
to  include  the  class  "atmosphere"  of  respect  for,  and  interest  in, 
their  work. 

The  form,  as  sent  to  the  superintendents,  is  shown  on 
the  following  page. 
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List  of  Items  for  Testing  Teaching  Efficiency  in  the  Elementary  School 

Score  feach  of  your  elementary  teachers  in  each  of  the  items  listed  below.    Items  A  and  B  are  to  be  scored  first  for  each  teacher,  on  the  basis  of  the  knowledge  that  you  already  have  of  the  teacher 

and  he^WOr^  ^  clistinguish  carefully  between  item  A,  the  total  efficiency  of  the  teacher  in  all  of  her  relations  and  activities ;  and  Item  B.  the  actual  teaching  ability  of  the  teacher  or  her  ability  to 
conduct  the  work  of  the  classroom.  The  ratings  on  items  i  to  10  inclusive,  should  be  made,  if  possible,  during  the  observation  of  a  complete  recitation.  Item  1)  .s  identical  with  I,  above,  but  should  be 
scored  after  all  the  ratings  above  it  have  been  made.    E,  F  and  G  may  be  filled  in  at  any  time.  ...  ,„  , 

The  ratings  are  to  be  made  on  a  scale  of  i  to  10.  "I"  will  be  understood  as  exceptionally  good,  "io  as  very  poor,  and  the  other  numbers  as  intermediate  degrees.  1  lease  unto  the  ligures  repre- 
senting your  ratings  plainly  in  the  rectangles  opposite  each  item  for  each  teacher. 


Teacher  1 

w 

CO 

10 

00 

CO 

 h 

In. 

— t- 

00 

0 

r?  j 

M 

A.    Estimate  of  the  total  efficiency  of  the  teacher  (social,  moral, 
educational,  etc.)  in  her  relations  to  the  school,  the  com- 
munity, etc. 

B.    General  estimate  of  the  teacher's  actual  teaching  ability. 



C.    Specific  items  rated  on  basis  of  class  (recitation)  : 

i.    Speech.    (Modulation  and  quality  of  voice  and  rate  and  enun- 
ciation of  speech. 

2.    Governing  skill.    (Are  the  pupils  serious  or  flippant,  natural  or 
constrained  ?) 

3.    Use  of, English  (By  teacher  and  pupils.) 

4.    Teacher's  skill  in  the  organization  of  the  material  of  the  recita- 
tion. 

5.    Teacher's  ability  to  fix  the  recitation  in  its  proper  setting  in  the 
course  (connecting  work  with  preceding  and  following  reci- 
tations.) 

6.    Proper  stressing  of  relative  values  (distinguishing  fundamen- 
tal from  accessory.) 

7.    Skill  in  directing  habit-formation. 

8.    Skill  in  questioning  (Are  the  questions  clear,  relevant,  too 
many,  too  difficult,  too  plainly  suggestive  of  the  answer?) 

9.    Skill  and  care  in  assignment  (Making  clear  to  the  pupils  the 
amount  of  material  to  be  covered  and  preparing  them  for  it.) 

10.    Choice  and  use  of  illustrative  material. 

D.    General  estimate  of  the  teacher's  actual  teaching  efficiency. 
Made  after  specific  rating. 

E.    Teacher's  total  number  of  years  experience. 

F.    Number  of  vears  in  the  present  town. 

G    Training :   No.  of  years  in  high  school,  normal  school  or  college 

The  questions  in  parenthesis  are  merely  suggestive  and  are  not  to  be  answered. 


Person  rating., 


City. 


Date. 


-101- 

The  forms  were  sent  out  near  the  middle  of  February  and 
by  the  twenty-second  of  March,  when  the  data  were  worked  up, 
thirty-two  superintendents  had  sent  in  their  ratings  upon  four 
hundred  fifty-eight  teachers. 

These  superintendents  apparently  found  little  difficulty 
in  interpreting  the  items  of  the  form.     In  the  cases  of  only  four 
teachers  were  they  incompletely  filled  out.     This  evidence  of  the 
superintendents  contributes  strong  support  to  the  judgment  of  the 
writer  that  the  items  of  this  form  can  be  easily  understood  and 
that  they  enter  into  practically  all  recitations.  Superintendents 
would  hardly  have  used  the  form  to  any  such  extent  as  they  did, 
had  it  not  been  satisfactory. 

1.     Correlations  and  Conclusions  Based  on  the  Superin- 
tendents' Ratings.     In  the  studies  of  Boyce  and  Ruediger  and  Stray® 
the  superintendents  were  asked  to  make  a  general  estimate  of  the 
efficiency  of  the  teacher,  after  making  a  detailed  ranking  or  rat- 
ing 1.     The  writer  wished  to  know  just  what,  in  the  opinion  of  the 
superintendents,  are  the  important  componsts  of  general  efficiency. 
With  this  in  view,  he  included  with  the  ten-division  rating  form 
the  two  more  general  divisions;  A  "Total  Efficiency",  and  B  "Actual 
Teaching  Efficiency",  and  later  determined  the  correlation  between 
the  two.     This  correlation,  based  on  the  ratings  of  four  hundred 
fifty-eight  teachers  is  .94  (P.  E.  0.05). 

This  very  high  correlation  shows  that  the  class  room 
work  is  the  determining  factor  in  the  superintendents'  estimates 
of  their  teachers.    According  to  these  figures,  the  superintendents 
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do  not  consider  the  social  adaptability  and  outside  interests 
of  the  teacher  except  insofar  as  these  are  found  in  connection 
with  ability  in  the  work  of  the  classroom.     Extra-echool  interests 
of  the  right  sort,  and  general  social  adaptability  are  probably 
generally  found  in  the  person  who  ranks  high  in  Teaching  Ability, 
and  vice  versa.     This  seems  to  be  a  better  explanation  of  the 
high  correlation  than  the  explanation  that  all  of  the  qualifica- 
tions of  a  teacher  except  Teaching  Ability  are  considered  unim- 
portant by  the  superintendent. 

In  order  to  ascertain  just  what,  in  the  opinion  of  the 
superintendents,  is  the  relative  importance  of  each  of  the  ten 
items  of  the  form  in  determining  teaching  ability,  correlations 
between  Teaching  Ability  and  each  of  the  ten  items  of  the  form 
have  been  determined.    These  correlations  are  shown  in  the  follow- 
ing table: 

Correlations  Based  on  Classroom  Ratings 
of  458  Teachers  by  32  Superintendents 
Correlation  between  rating  in  General  Teaching  Ability 


by  superintendents  and: 

0  Rank 

Speech                                                                           .  78  8 

Governing  Skill  .                            .90  4 

Use  of  English                                                              *  79  7 

Teacher's  Skill  in  the  Organization  of  the 

Material  of  the  Recitation                                     .91  3 

Teacher1 s  Ability  to  Fix  the  Recitation  in  its 

Proper  Setting  in  Course  •                         .91  3 

Proper  Stressing  of  Relative  Values  !s9  5 

Skill  in  Directing  Habit- Format  ion                             .92  2 

Skill  in  Questioning                                                    .97  1 

Skill  and  Care  in  Assignment                                       \  89  5 

Choice  and  Use  of  Illustrative  Material                    .86  6 
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It  will  "be  noted  here  that  there  is  a  strong  positive 
correlation  between  Teaching  Ability  and  each  one  of  the  ten 
items  of  the  form,  but  that  some  of  the  items  are  more  closely 
correlated  with  Teaching  Ability  than  others. 

Speech  ranks  lowest  of  all  the  items  and  Skill  in  Ques- 
tioning ranks  highest.    Just  as  in  earlier  studies,  Superinten- 
dents in  this  investigation  also  apparently  consider  purely  physi- 
cal qualities,  such  as  voice,  as  of  least  importance  in  teaching 
ability. 

Governing  Skill  does  not  show  so  high  a  correlation, 
relatively,  as  it  did  in  the  study  of  Ruediger  and  Strayer.  While 
it  ranks  fifth,  however,  it  is  really  very  little  below  any  other 
item  except  Itemw8fJ 

It  is  not  surprising  that  Skill  in  Questioning  should 
play  an  important  part  in  determining  the  superintendent's  judg- 
ment of  teaching  ability.     The  very  large  part  that  the  question- 
and-answer  method  play  in  the  recitation  in  the  elementary  school 
makes  the  ability  to  originate  and  frame  questions  a  very  neces- 
sary qualification  for  good  teaching.     The  lack  of  this  ability 
is  almost  sure  to  be  evident  in  any  recitation.     Certain  very 
important  and  almost  always  observable  factors,  such  as  the  one 
just  mentioned,  are  likely  to  become  fixed  in  one's  mind  as  factors 
denoting  good  teaching.     On  ther  other  hand,   such  items  as  "Choice 
and  Use  of  Illustrative  Material"  are  so  variable  that  they  are 
not  likely  to  be  recognized  as  so  important,  and  considering  a 
large  number  of  recitations,  they  probably  are  not.     The  need  for 
illustrative  material,  of  course,  differs  greatly  in  different 

-—  — - 
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types  of  recitations  and  in  different  subjects,  while  the  "Dir- 
ection of  Habit  Formation"  and  "Questioning"  are  much  more  constant 
and  consistent  factors1. 

The  correlation  of  +0.33  between  the  superintendents' 
ratings  in  General  Teaching  Ability,  and  the  experience  of  the 
teachers  is  significant.     It  will  be  remembered  in  this  connection 
that  the  correlation  between  experience  and  the  average  rating  on 
the  form  was  -.46.     In  the  case  of  these  86  teachers  rated  on  the 
form,  however,  the  training  of  the  groups  with  various  amounts  of 
experience  seems  to  offer  a  reasonable  explanation. 

The  median  experience  of  these  teachers  is  just  eight 

years. 

The  positive  correlation  between  the  superintendent's 
rating  and  the  teacher's  experience  shows  that  experience  is  in 
some  way  related  to  the  factors  which  determine  the  superintendent' 
estimate  of  the  teaching  ability  of  his  teachers.     It  was  thought 
that  superintendents  might  be  disposed  to  rank  a  teacher  somewhat 
higher  because  of  that  teacher's  experience  in  the  superintendent's 
own  system.     The  correlation  between  the  teachers'  Experience  in 
the  Present  System  and  General  Teaching  Ability,  however,  is  0.39 
(P.E.  0.05),  or  slightly  less  than  the  correlation  between  General 
Teaching  Efficiency  and  Total  Teaching  Experience  0.33  (P.E.  0.05). 

The  teachers'  experience  is  more  closely  correlated  with 

lAnother  explanation  of  this  low  correlation,  which  has  some- 
times been  advanced,  is  that  a  high  rank  in  physical  qualities 
is  a  prerequisite  for  all  teaching  positions. 
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the  superintendents'  ratings  in  the  particular  item  Governmental 
Skill  than  with  their  ratings  in  General  Teaching  Ability.  The 
correlation  with  this  particular  item  is  .39  (P.E.  0.05).     On  the 
other  hand,  there  is  practically  no  correlation  (-.01)  between  the 
teacher's  training  and  his  rating  in  this  item.     These  two  correl- 
ations point  to  the  conclusion  that  the  institutions  which  train 
teachers  have  not  yet  found  a  good  substitute  for  the  ordinary 
school,  to  develop  in  their  prospective  teachers  the  ability  to 
manage  children  and  secure  their  cooperation  in  the  classroom  work. 

Opposite  each  item  of  the  form  in  the  following  table 
is  placed  the  median  of  the  ratings  of  all  teachers  in  that  item. 


Speech  

Governing  Skill  2.59 

Skill  and  Care  in  Assignment  2*  59 

Choice  and  Use  of  Illustrative  Material  2]  65 

Use  of  English  2.67 

Teacher's  Skill  in  the  Organization  of  the  Material 

of  the  Recitation  2.68 

Teacher's  Ability  to  Fix  the  Recitation  in  its  Proper 

Setting  in  the  Course   2.69 

Skill  in  Questioning—  2.74 

Proper  Stressing  of  Relative  Values  2.* 80 

Skill  in  Directing  Habit-Formation  2.97 


The  teachers,  on  the  whole,  are  rated  highest  in  Speech 
and  lowest  in  Skill  in  Directing  Habit- Format ion.     There  is  not, 
however,  any  large  difference  between  these  median  ratings  in  any 
two  items.     There  is  no  one  of  these  abilities  in  which  we  can  say, 
on  the  basis  of  these  ratings,  that  teachers  rank  relatively  very 
high  or  very  low.     It  would  probably  be  safe  to  conclude  that 
teachers,  as  a  rule,  have  developed  their  voice  and  speech  to  a 
somewhat  higher  point  of  efficiency  than  their  SkillDin^Habii- 
Forraation. 
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Th  e  uniformly  high  rating  of  the  teachers  in  all  of  the 
items  of  the  form  is  no  doubt  due,  in  some  measure,  to  the  method 
of  rating.     The  method  used  throughout  the  study  was  to  secure  rat 
ings  rather  than  rankings  in  estimating  the  efficiency  or  ability 
of  the  teachers.     There  are  advantages,  as  well  as  disadvantages, 
in  each  method. 

The  rank  order  (the  method  which  Eoyce  used  in  his  ear- 
lier study  but  which  he  discarded  in  favor  of  the  rating  method 
in  his  later  study)  has  the  advantage  of  securing  a  finer  distri- 
bution wherever  it  can  be  used.     However,  in  compelling  this  fine 
distribution,  where  many  teachers  are  involved,  it  often  produces 
forced  and  even  false  distinctions.    Again,  a  distribution  secured 
by  the  rank-order  method  gives  one  no  idea  of  the  relative  degrees 
of  merit  represented  by  the  various  ranks.     The  implication  is, 
ofcourse,  that  the  difference  between  any  teacher's  position  and 
the  position  of  the  teacher  just  below  is  exactly  equal  to  the 
difference  between  the  same  teacher's  position  and  the  position 
of  the  teacher  just  above. 

The  advantage  of  the  method  of  rating  by  definite  steps 
is  that  the  person  rating  can  express  the  difference  between  the 
ratings/of  two  teachers  in  terras  of  a  unit.     This  method  thus  al- 
lows much  more  freedom  in  fixing  the  relative  positions  of  the 
various  teachers.     The  disadvantage  of  rating,  as  compared  with 
ranking,  is  that  in  allowing  a  grouping,  instead  of  forcing  a 
distinction  between  each  pair  of  teachers,  it  may  cause  superin- 
tendents to  make  a  less  careful  study  of  each  individual  teacher 
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and  a  less  discriminating  distribution. 

The  writer  experimented  with  both  methods.     The  super- 
intendent in  one  of  the  two  cities  in  the  first  investigation 
was  asked  to  rank  his  thirty  teachers.     He  succeeded  in  grouping 
these  teachers  into  five  degrees  of  teaching  ability,  "1",  "2M, 
"3",   "4"  and  "5",  but  he  explained  in  doing  so,  that  the  distinc- 
tion between  groups  "1"  and  n3"  and  between  "4"  and  n5n  was  very 
slight,  and  difficult  to  make.     This  evidence,  together  with  some 
experience  of  his  own  as  a  high  school  principal,  in  estimating 
the  efficiency  of  teaching,  influenced  the  writer  in  reaching 
the  conclusion  that  a  method  of  rating,  covering  five  degrees  of 
merit,  would  provide  for  the  exercise  of  as  much  discrimination 
as  the  superintendents  and  the  persons  using  the  form  would  exer- 
cise. 

The  five-group  rating  method  was  used  in  the  ratings  on 
the  form  by  the  writer  and  those  assisting  him.    When  the  form 
was  later  sent  to  the  superintendents  throughout  the  state  of 
Illinois,  for  use  in  their  school  systems,  provision  was  made  for 
distinguishing  among  ten  degrees  of  merit,  i.e.,  "I"  to  "10",  in- 
clusive.    (See  form,  page  100. )  The  larger  number  of 
divisions  of  merit  in  the  latter  instance  did  not  materially  af- 
fect the  form  of  the  distribution,  except  to  cause  the  ratings 
to  be,  in  general,  somewhat  higher.    Both  the  1-5  and  the  1-10 
group  methods  of  ratings  were  used  by  the  superintendents  of  the 
two  cities  first  investigated,  as  shown  in  the  table. 

The  writer  does  not  propose  a  teacher-rating  scale. 
While    the  correlations  between  the  various  items  and  General 
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Teaching  Ability  have  been  worked  out,  he  does  not  feel  justified 
in  drawing  from  them  any  conclusions  as  to  the  importance  of  each 
of  the  items.     The  items  presented  in  this  study  are  items  which 
have  been  tested  in  use  as  no  other  items  or  qualities  of  teaching 
ability  of  which  the  writer  has  any  knowledge.    He  has  used  them 
in  visiting  recitations  totalling  three  weeks  school  time,  and  the 
persons  assisting  him  have  used  them  for  a  shorter  time.     A  number 
of  teachers  in  one  city  used  them  in  cooperation  with  their 
superintendent.     Thirty-two  school  superintendents  in  various  sec- 
tions of  the  state  of  Illinois  have  used  them  in  connection  with 
the  work  of  four  hundred  fifty-eight  teachers. 

There  are  two  characteristics  of  the  present  study  which 
should  again  be  emphasized.     In  the  first  place  the  study  was  con- 
cerned exclusively  with  the  recitation,  rather  than  with  the 
teacher's  "total  efficiency".     In  the  second  place,  the  investiga- 
tion has  been  cooperative  in  so  far  as  the  writer  could  make  it 
so.     After  the  teachers  had  been  rated?- copies  of  the  form  were 
distributed  among  teachers,  as  well  as  superintendents,  and  all 
were  invited  to  criticize  and  comment  upon  it  freely.     The  writer 
is  confident  that  the  cooperative  method  is  the  method  by  which 
most  good  can  be  accomplished. 


The  teachers  were  not  consulted  before  the  rating  because  the 
writer  did  not  then  have  time  to  explain  the  form  to  all  of 
them  fully;  and  he  judged  it  best,  in  order  to  secure  compara 
ble  data,  to  attempt  no  explanation  at  that  time. 


I 
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SUMMARY  AND  CONCLUSIONS 

I.     Schemes  in  Use  and  Schemes  Projected  for  Estimating 
the  Efficiency;  of  Teachers 

A.     Examinations  and  superintendents'  general  estimates 
now  constitute  the  principal  bases  for  estimating  teaching  ability 
in  the  elementary  schools  of  the  smaller  cities. 

E.     Some  kind  of  printed  forms  are  in  use  in  the  majority 
of  the  large  cities. 

C.  The  scales  in  use  in  rating  teachers  in  the  cities 
attempt,  as  a  rule,  to  measure  the  "total  efficiency"  of  the 
teacher,  rather  than  merely  his  "teaching  ability". 

D.  Similarly,  scales  projected  for  general  use  have, 
like  the  scales  of  the  large  cities,  represented  attempts  to  meas- 
ure the  "total  efficiency"  of  the  teacher.     As  a  result,  they 
have  either  employed  a  few  terras  so  general  and  inclusive  as  to  be 
open  to  many  interpretations,  or  they  have  included  so  many  items 
as  to  be  cumbersome  in  use. 

E.  The  present  tendency  in  constructing  scales  for 
teachers  in  the  cities  is  toward  finer  differentiation  and  greater 
elaboration. 

II. 

The  development  of  scales  and  tests  in  the  elementary 
school  subjects  is  analogous  to  the  development  of  scales  for 
rating  teachers.     The  former,  like  the  latter,  have  developed 
and  are  developing,  toward  more  discriminating  tests.     The  attempt 
is  being  made  in  recent  scales  and  tests,  to  test  specific  abili- 
ties rather  than  "general  merit"  or  general  ability. 
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III. 

A.  Ratings  on  the  Thorndike  scale  for  handwriting,  on 
the  basis  of  the  experimental  evidence  contained  in  this  study, 
are  more  variable  than  ratings  on  the  Ayres  scale. 

B.  On  the  other  hand,   the  Ayres  scale  does  not  include 
specimens  so  low  in  quality  as  some  samples  of  writing  from  the 
third  grade. 

C.  From  the  two  preceding  tentative  conclusions,  it 
follows  that  the  Ayres  scale  is  the  better  of  the  two  for  use  in 
grades  4-8,  while  the  Thorndike  scale  is  the  better  scale  for  use 
in  the  grades  below  the  fourth. 

IV. 

The  data  of  this  study  show,  in  so  far  as  they  are  relia- 
ble, that  success  in  developing  in  pupils  such  a  specific  ability 
as  that  which  the  Courtis  tests  measure  is  not  necessarily  asso- 
ciated with  a  high  degree  of  General  Teaching  Ability. 

The  following  conclusions,  based  upon  an  intensive  study 
of  two  city  school  systems,  support  the  above  inference: 

A.  A  high  negative  correlation  exists  between  the  im- 
provement of  pupils  in  the  work  of  the  Courtis  tests  and  the  rating 
of  corresponding  teachers  on  the  rating  form. 

B.  A  negative  correlation  exists  between  the  improve- 
ment of  pupils  in  the  work  of  the  Courtis  tests  and  the  superin- 
tendents' ratings  of  the  corresponding  teachers  in  General  Teach- 
ing Ability. 

C.  A  high  negative  correlation  exists  between  the  im- 
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provement of  pupils  in  the  work  of  the  Courtis  testa  and  the 
improvement  of  the  same  pupils  in  handwriting. 

D.  Mechanical  arithmetical  example  cards  can  be  used  to 
advantage  in  increasing  the  pupil's  ability  in  solving  the  Courtis 
arithmetic  examples,  while  it  may  be  seriously  questioned  whether 
the  extensive  use  of  such  advice  denotes  General  Teaching  Ability. 

E.  The  correlation  between  the  improvement  of  pupils 

in  the  work  of  the  Courtis  tests,  and  the  ability  of  corresponding 
teachers  to  solve  the  examples  of  the  same  tests  is  0.63.  The 
natural  conclusion  from  this  correlation  is  that  the  teacher  who 
is  very  proficient  in  such  specific  work  as  that  included  under 
the  Courtis  tests  is  likely  to  advance  his  pupils  proportionately 
fast  in  the  work  of  the  same  tests.    This  correlation  in  so  far 
as  the  conditions  in  the  two  school  systems  tested  wers  normal,  in- 
dicates that  the  progress  of  pupils  in  the  work  of  the  Courtis 
tests  is  correlated  with  a  very  specific  ability  of  the  teacher. 

F.  A  positive  correlation  (0.3S)  exists  between  the 
ratings  of  the  superintendents  and  the  ratings  made  on  the  form, 
and  a  higher  correlation  (0.46)  exists  between  the  ratings  of 
the  various  persons  using  the  form. 

V. 

A.     When  all  of  the  (86)  teachers  personally  visited 
are  considered  as  one  group,  the  correlation  between  form-rating 
and  experience  is  negative,  which  seems  to  indicate  tbat  exper- 
ience in  teaching  is  most  often  accompanied  by  comapartively 
low  teaching  ability. 
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E.     When  the  teachers  are  considered  in  five  groups, 
however,  on  the  basis  of  number  of  years  of  experience  (1-5,  6-10, 
11-15,  16-30,  and  21-38)  the  group  which  has  had  (6-10)  years 
experience  is  rated  highest. 

C.  The  median  number  of  years  experience  of  the  various 
groups  of  teachers,  when  they  are  grouped  on  the  basis  of  training, 
show  that,  in  general,  those  teachers  who  have  had  little  training 
in  preparation  for  teaching  have  had  more  experience  than  the 
teachers  who  have  had  more  training. 

D.  The  normal  school  graduates,  probably  the  best 
trained  group  for  teaching  in  the  elementary  schools,  have  had 
very  much  less  experience  in  teaching  than  any  other  group. 

The  facts  contained  in  the  four  preceding  paragraphs 
indicate  that,  in  so  far  as  the  86  teachers  here  considered  is 
representative,  training  is  mors  important  than  experience  in  deter 
mining  the  ability  which  the  form  measures. 

Sixty-three  per  cent  of  the  teachers  in  grades  one  and 
two  are  rated  above  the  median  on  the  form. 

School  children  tend  to  write  at  a  uniform  rate,  regard- 
less of  instructions. 

The  following  conclusions  are  based  on  33  Illinois 
superintendents'  ratings  of  458  teachers  on  the  rating  form: 

1.  The  superintendent's  estimate  of  his  teacher's  "total 
efficiency"  is  very  closely  correlated  with  his  estimate  of  the 
teacher's  General  Teaching  Efficiency. 

2.  According  to  the  superintendents'  ratings,  teachers 
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are  strongest  in  Speech  and  weakest  in  Skill  in  Directing  Habit- 
Formation. 

3.  The  median  number  of  years  experience  of  Illinois 
elementary  teachers  in  the  towns  and  small  cities,  based  on  the 
returns  from  those  investigated  in  this  study,  is  just  eight 
years. 

4.  The  experience  of  teachers  is  positively  correlated 
with  the  superintendent's  estimate  of  them  in  General  Teaching 
Ability,  and  is  somewhat  more  closely  correlated  with  his  rating 
of  them  in  Governmental  Skill.     This  probably  indicates  that  ex- 
perience is  a  factor  in  determining  Teaching  Ability  and  a  more 
important  factor  in  determining  Governmental  Skill,  as  estimated 
by  the  superintendent. 

5.  The  superintendent's  estimate  of  General  Teaching 
Ability  in  teachers  is  somewhat  less  closely  correlated  with  the 
teachers'  experience  in  the  superintendent's  own  school  system 
than  with  the  teacher's  total  teaching  experience.     This  probably 
indicates  that  the  Illinois  superintendent  is  not  unduly  influ- 
enced in  his  estimate  of  a  teacher's  teaching  ability,  by  the  fact 
that  the  teacher  has,  or  has  not,  gained  most  of  his  experience 
in  the  superintendent's  particular  school  system. 

VI. 

The  ten-item  rating-form  presented  in  this  study  has 
baan  used  satisfactorily  by  superintendents  and  by  persons  not 
connected  with  the  school  system. 
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C.  L.  Phelps:    A  Study  of  Errors  in  Tests  of  Adding  Ability.  Vol. 

14,  Sept.,  1913.   Pp.  29-40. 

F.  N.  Freeman:     Some  Practical  Studies  of  Handwriting.     Vol.  14, 
Dec,   1913.     Pp.  117-180. 

C.  H.  Judd:    Reading  Tests.     Vol.  Apr.,   1914.  Pp.  365-374. 

Clara  Schmidt:     School  Subjects  as  Material  for  Tests  of  Mental 
Ability.  Vol.  15,  Nov.,  1914.  Pp.  150-162. 

H.  A.  Brown:    The  Measurement  of  Efficiency  in  Reading.  Vol.14. 
June,  1914.  Pp.  477-491. 

S.  A.  Courtis:     Standard  Tests  in  English.     Vol.  14.  Apr.,  1914. 
Pp.  374-393. 

Frank  P.  Eachman:     Variations  in  Study  Standards.     Vol.  15,  Dec, 

1914.  Pp.  210-219. 

Karl  Douglas  Waldo:     Tests  in  Reading  in  the  Sysamore  Schools.  Vol 

15,  Jan.,  1915.  Pp.  351-269. 

Herschel  T.  Manuel:    The  Use  of  an  Objective  Scale  for  Grading 
Handwriting.     Vol.   15.  Jan., 1915.  Pp.  269-279. 

E.  E.  Oberholzer:     Testing  the  Efficiency  in  Peadinsr  in  the  Grades. 
Vol.   15.   Pp.  313-323. 

Henry  A.  Lane:     Standard  Tests  as  an  Aid  to  Supervision.  Vol.  15, 
Pp.  378-387. 

Frank  N.  Freeman:    An  Analytical  Scale  for  Judging  Handwriting. 
Vol.  15,   Apr.  1915.   Pp.  433-442. 

Ella  M.  Monk:     The  Washington,  D.C.  Spelling  List.     Vol.  16, 
October,  1915.     Pp.  96-104. 

J.  David  Houser:     The  Relation  of  Spelling  Ability  to  General  In- 
telligence and  to  Meaning  Vocabulary.     Vol.  16,  Dec,  1915 
Pp.  200-209. 
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Ella  M.  Monk:     The  Washington,  D.C.  Spelling  List.     October,  1915. 
Pp.  96-104. 

J.  David  Houser:     The  Relation  of  Spelling  Ability  to  General 

Intelligence  and  to  Meaning  Vocabulary.     December,  1915. 
Vol.  16.     Pp.  190-200. 

S.  Monroe  Graves:     The  Improvement  in  Handwriting  of  Feebleminded 
Children.  Dec,  1915.  Vol.  16.  Pp.  200-209. 

William  S.  Gray:     Methods  of  Testing  Reading.     Jan. ,1916.     Vol.  16. 
Pp.  231-247. 

William  S.  Gray:     Methods  of  Testing  Oral  and  Silent  Readine-. 

Feb.   1916.  Vol.  16.   Pp.  281-299. 

Frank  N.  Freeman:     Handwriting  Tests  for  Use  in  School  Surveys. 
Feb.,   1916.  Vol.   16,   Pp.  299-302. 

George  L.  Johnson:    Measuring  the  Quality  of  Handwriting.  Feb.,  19lfe. 
Vol.  16,   Pp.  302-316. 

L.  W.  Mayberry:     Measuring  Progress:  March,  1916.  Vol.  16,  Pp. 381- 
388. 

—  —  Waldo:     Tests  in  Reading:  in  Sycamore  Schools.     Vol.  15.  Pp. 
376-378. 

The  Forum 

J.  M.  Rice:     The  Futility  of  the  Spelling  Grind.     Vol.  XXIII.  Pp. 
163-172  and  409-410. 

J.  M.  Rice:    Educational  Research.     A  Test  in  Arithmetic.  Vol.  XXXiV 
Pp.  231-297. 

J.  M.  Rice:     Causes  of  Success  and  Failure  in  Arithmetic.  Vol. 
XXXIV.   Pp.  437-452. 

J.  M.  Rice:     Educational  Research.     The  Results  of  a  Test  in  Lan- 
guage. Vol.   XXXV.  Pp.  269-293. 

The  Fourteenth  Year-Book  of  the  National 
Society  for  the  Study  of  Education 
S.  A.  Courtis:     Standards  in  Rates  of  Reading.  Pp.  44-59. 
R.  G.  Jones:    Vocabulary.  Pp.  37-44. 
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The  Fifteenth  Year-Eook  of  the  National  Society 
for  the  Study  of  Education 
Part  I.     Standards  and  Tests  for  the  Measurement  of  the 
Efficiency  of  Schools  and  School  Systems. 

F.  N.  Freeman:     The  Teaching  of  Handwriting.     Houghton  &  Mifflin. 

J.  E.  W.  Wallin:     Spelling  Efficiency.  1911,  Warwick  and  Work. 
Baltimore. 

Houston:     Manual  of  Penmanship  and  Guide  to  Fating.     New  Haven, 1912 

Cook  and  O'Shea:     The  Child  and  His  Spelling.     The  Eobbs-Merrill 
Co.  1914.  Indianapolis. 

0.  P.  Cornman:     Spelling  in  the  Elementary  School.     Ginn  and  Co. 
1902.  Eoston. 

J.  M.  Rice:     Scientific  Management  in  Education.     Hinds,  Noble  and 
Eldredge.  N.Y. 

C.  W.  Stone:    Arithmetical  Abilities  and  Some  Factors  Determining 
Them. 

Columbia  Contributions  to  Education,  Teachers  College  Series.  No. 
19.  1908. 

E.  P..  Buckingham:     Spelling  Ability,  Its  Measure  and  Distribution. 

Teachers  College,  Columbia  University  Con tdtout ions  to 
Education,  No.  59,  1913. 


Teacher  * s  College  Record 

E.  L.  Thorndike:     Handwriting.  March,  1910.  Vol.  11.  Pp.  1-93. 

Milo  F.  Hillegas:     Scale  for  the  Measurement  of  Quality  in  English 
Composition  by  Young  People.     Sept.,  1912.  Vol.  13. 

Thomas  H.  Eriggs:     Formal  English  Grammar  as  a  Discipline.  Sept., 
1913.  Part  II,  Vol.  14.  Pp.  15-45  and  57-92. 

E.  L.  Thorndike:     The  Measurement  of  Ability  in  Reading;  Prelimi- 
nary Scales  and  Tests.     Sept.,  1914.  Vol.  15.  Pp.  1-67. 

E.  L.  Thorndike:     The  Measurement  of  Achievement  in  Drawing.  Nov., 
1913.   Pp.  1-38. 

E.  L.  Thorndike:     Teachers'  Estimates  of  the  Quality  of  Specimens 
of  Handwriting.  Nov.,   1914.  Vol.   15.  Pp.  1-13. 
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E.  L.  Thorndike:     An  Improved  Scale  for  Measuring  Ability  in  Read- 
ing.  Dec,  1915.  Vol.   16.  Pp.  31-54  and  Jan.,  1916. 
Vol.  17.  Pp.  40-68. 

W.  S.  Gray:    A  Provisional  Scale  for  Measuring  the  Ability  to 
Pronounce  English  Sentences.  May,  1914.  Vol.  15. 


George  Drayton  Strayer:  Measuring  Results  in  Education.  Vol.  3. 
Pp.  3-10. 

E.  L.  Thorndike:    A  Scale  for  Merit  in  English  Writing  by  Young 
People.  Vol.  3.  Pp.  361-368. 

Irving  King  and  Harry  Johnson:  The  Writing  Abilities  of  the  Ele- 
mentary and  Grammar  School  Pupils  of  a  City  School  Sys- 
tem Measured  by  the  Ayres  Scale.     Vol.  3.  Pp.  514-530. 

D.  Starch:    The  Measurement  of  Handwriting.  Oct.,  1913.  Vol.  4. 
Pp.  445-465. 

D.  Starch:     Correlations  Among  Abilities  in  School  Studies.  Sept., 

1913.   Vol.  4.   Pp.  415-419. 

Rudolph  Pintner:  Oral  and  Silent  Reading  of  Fourth  Grade  Pupils. 
June,   1913.  Vol.  4.  Pp.  333-338. 

W.  H.  Heck:  The  Efficiency  of  Grammar  Grade  Pupils  in  Reasoning 
Tests  in  Arithmetic  at  Different  Periods  of  the  School 
Day.     Feb.,  1914.  Vol.  5.  Pp.  93-95. 

G.  R.  Davies:     Elements  of  Arithmetical  Ability.     March,  1914.  Vol. 
5.  Pp.  131-141. 

L.  E.  Frailey  and  C.  M.  Crain:     Correlations  of  Excellence  in 
Different  School  Subjects  Based  on  A  study  of  School 
Grades.  (?) 

E.  R.  Buckingham:     The  Courtis  Tests  in  the  Schools  of  New  York 

City.     April,  1914.  Vol.  5.  Pp.  199-315. 

J.  Carlton  Bell:     A  Class  Experinent  in  Arithmetic.     Oct.,  1914. 
Vol.   5.   Pp.  467-471. 

Rudolph  Pintner:     A  Comparison  of  the  Ayres  and  Thorndike  Handwrit- 
ing Scales.    Nov.  1914.  Vol.  5.  Pp.  535-537. 

Daniel  Starch:     The  Measurement  of  Achievement  in  English  Grammar. 
Dec,   1915.  Vol.   6.   Pp.  615-637. 
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L.  W.  Sackett:     Disparity  of  Spelling  Scales:     Dec,  1915.  Vol.  6. 
Pp.  627-630. 

D.  Starch:     The  Measurement  of  Efficiency  in  Spelling.  Vol.  16. 
Pp.  167-186. 

D.  Starch:-  The  Measurement  of  Efficiency  in  Reading.     Jan.,  1915. 
Vol.   6.   Pp.  1-25. 

C.  Truman  Gray:     The  Training  of  Judgment  in  the  Use  of  the  Ayres 

Scale  for  Handwriting.     Feb.,  1915.  Vol.  6.  Pp. 85-99. 

D.  Starch:     The  Measurement  of  Efficiency  in  Handwriting.  Feb., 

1915.  Vol.   6.  Pp.  106-115. 

Cyrus  D.  Mead:     Silent  Versus  Oral  Reading  with  One  Hundred  Sixth 
Grade  Children.     June,  1915.  Vol.  6.  Pp.  345-349. 

H.  G.  Childs:     Measurement  of  the  Drawing  Ability  of  2177  Children 
in  Indiana.     School  Systems 

by  a  Supplemented  Thorndike  Scale.     Sept.,  1915. 
Vol.  6.   Pp.  391-409. 

R.  R.  Rusk:    A  Class  Experiment  in  Scoring  Handwriting.  Vol.  5. 
Pp.  417-418. 


Educational  Administration  and  Supervision 

Don  C.  Bliss:     School  Measurement  and  School  Administration.  Feb,, 
1915.  Vol.  1.  Pp.  79-89. 

S.  A.  Courtis:     Educational  Diagnosis.  Feb.,   1915.  Vol.  1.  Pp.  89- 
117. 

E.  L.  Thorndike:     Means  of  Measuring  Achievements  in  Handwriting. 
May,  1915.  Vol.  1.   Pp.  300-305. 

E.  L.  Thorndike:     Means  of  Measuring  Achievements  in  Spelling. 
May,  1915.  Vol.   1.  Pp.  306-313. 

E.  C.  Witham:     All  the  Elements  of  Handwriting  Measured.     May,  1915 

Vol.  1.  Pp.  313-325. 

H.  0.  Rugg:     Standardizing  Standards  in  Education.     May,  1915. 
Vol.   1.   Pp.  325-327. 
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E.  E.  Lewis:     The  Present  Standard  of  Handwriting  in  Iowa  Normal 
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Training  High  Schools.  Dec,  1915.  Vol.  1.  Pp.  663-672. 

The  American  School  Board  Journal 

Don  C.  Blies:     The  Standard  Test  Applied.     May,  1912.  Vol.  44  and 
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E.  C.  Witham:     A  Method  of  Measuring  Handwriting.     May,  1914.  Pp. 
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The  School  Review 

E.  L.  Thorndike:     The  Measurement  of  Educational  Products.  May, 

1912.  Vol.   20.   Pp.  289-300. 

Leonard  P.  Ayres:     Measuring  Educational  Products  Throusrh  Educa- 
tional Results.     May,   1912.  Vol.  20,  Pp.  289-300. 

Efficiency  for  Efficiency1 s  Sake.     Vol.  23.  Jan.,  1915.  Pp.  34-43. 

Frances  Jenkins:     Standards  in  Elementary  English.  Jan.,  1915.  Pp. 
201-203.     School  and  Home  Education. 

William  R .  Hornbaker:    A  Spelling  Test  for  the  Whole  School. 

April,  1914.     The  Educational  Ei-Monthly.  Pp.  351-354. 

L.  P.  Ayres:     A  Scale  for  Quality  of  Handwriting  of  School  Children 
Bulletin  of  the  Division  of  Education  of  the  Russell 
Sage  Foundation.  1912.  No.  113. 

L.  P.  Ayres:    The  Spelling  Vocabularies  of  Personal  and  Business 
Letters.     Monograph  of  the  Division  of  Education  of  the 
Russell  Sage  Foundation.     New  York  City,  1913. 

L.  P.  Ayres:    A  Measuring  Scale  for  Ability  in  Spelling.  Division 
of  Education  of  the  Russell  Sage  Foundation.     New  York 
City,  1915. 

F.  W.  Ballou:     Scales  for  the  Measurement  of  English  Composition. 

Harvard-Newton  Bulletin  No.  11.     Harvard  University 
Press.     Cambridge,  Mass. 

0.  Truman  Cray:     A  Score  Card  for  the  Measurement  of  Handwriting. 
Bulletin  of  the  University  of  Texas.     1915.  No.  37. 

F.  J.  Kelly:    The  Kansas  Silent  Reading  Tests.     Bureau  of  Educa- 
tional Measurements  and  Standards.     State  Normal  School. 
Emporia,  Kansas. 


Geography:    A  Report  on  a  Preliminary  Attempt  to  Measure  Some  Edu- 
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cational  Results.     Bulletin  No.  V  of  the  Department  of 
Educational  Investigation  and  Measurement.  Boston 
Printing  Department,  1916. 

W.  S.  Monroe,  Director:  Report  of  a  Survey  of  the  Public  Schools 
of  Leavenworth,  Kansas.  Bureau  of  Educational  Measure- 
ments and  Standards.     Emporia,  Kansas. 

Ernest  J.  Ashbaugh:  Handwriting  of  Iowa  School  Children.  Exten- 
sion Division  Bulletin  No.  15,  University  of  Iowa. 

Frederick  G.  Bonser:     The  Reasoning  Ability  of  Children  of  the 
4th,  5th  and  6th  School  Grades.     Teachers  College, 
Columbia  University  Contributions  to  Education.  1910. 
Pp.  133. 

W.  Franklin  Jones:     Concrete  Investigation  of  the  Material  of 
English  Spelling.     Vermillion,   South  Dakota  booklet. 
1914. 

Second  Annual  Conference  on  Educational  Measurements  (Report) 
Indiana  University  Bulletin  No.  11.  1915.     Pp.  1-97, 
115-172  and  187-821. 

F.  S.  Breed  and  Vernon  Culp:     An  Application  and  Critique  of  the 

Ayres  Handwriting  Scale."  School  and  Society.  Oct.,  1915. 
Vol.  11.   Pp.  639-647. 

Seventeenth  Annual  Report  of  the  City  Superintendent  of  Schools. 

1914-1915.  Survey  of  the  Gary  and  Prevocational  Schools. 
New  York,  1916. 

Teachers1  Year-Book  of  Educational  Investigations.  Publication 

No.  6,  1915.     Department  of  Education,  City  of  New  York, 
Division  of  Reference  and  Research. 

Rice:     The  Need  of  a  New  Basis  in  Education.     Forum,  Vol.  XXXV. 
Pp.  440-457. 

Final  Report  of  the  Committee  on  School  Inquiry  for  New  York  City. 
Vol.   1.   Pp.  397-546. 

Horace  L.  Brittain,  Director:  Report  of  the  Ohio  State  School 
Commission.  Columbus,  Ohio.  1914.  Heer  Printing  Co. 
Pp.  133-146. 

M.  E.  Haggerty:    Arithmetic:  A  Cooperative  Study  in  Educational 
Measurements. 


Indiana  University  Studies.     Indiana  University 
Bulletin  No.  18,  1915. 
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W.  F.  Tidyman:  A  Critical  Study  of  Rice's  Investigation  of  Spel- 
ling Efficiency,     Sept.,  1915.  Vol.   XXII,"  Pp.  391-401. 

Jean  Dawson;    Measuring  the  End  Product.     June,  1915.  Vol.  XXII. 
Pp.  290-396. 

E.  L.  Thomdike:     Measurement  of  Ability  to  Solve  Arithmetical 

Problems.  Dec,  1914.  Vol.  XXI.  Pp.  495-504. 

Isidore  Kayfetz:     A  Critical  Study  of  the  Hillegas  Composition 
Scale.     Dec,  1914.  Vol.  XXI.  Pp.  559-578. 

F.  W.  Ballou:     The  Misuse  of  Standard  Tests  in  Education,  School 

and  Society.    April  1,  1916.     Vol.  3. 

E.  C.  Moore:    What  is  Education?  Pp.  394-314. 

F.  W.  Johnson:     The  Hillegas-Thorndike  Scale  for  Measurement  of 

Quality  in  English  Composition  by  Young  People.  School 
Review.  Jan.,  1913.   Pp.  39-50. 

Ernest  C.  Noyes:     Progress  in  Standardizing  the  Measurement  of 
Composition.     N.E.A.  Proceedings,  1913.  Pp.  ?63-?67. 

S.  W.  Strayer:  Report  of  the  Committee  on  Tests  and  Standards  of 
Efficiency  in  Schools  and  School  Systems.  N.E.A.  1913. 
Pp.  393-406. 

Clars  Schmitt:     Reading  and  Arithmetic  as  Tests  of  Mental  Ability. 
N.E.A.  Proceedings,  1914.  Pp.  848-851. 

C.  H.  Judd:    Reading  Tests.     N.E.A.     Proceedings,  1915.  Pp.  561-565 

0.  W.   Strayer:     The  Use  of  Tests  and  Scales  of  Measurement  in  the 
Administration  of  Schools.  N.E.A.  Proceedings,  1915. 
Pp.  579-583. 

III.     AIMS,   METHODS  AND  TECHNIQUE 
OF  TEACHING. 

Adams:     Exposition  and  Illustration  in  Teaching.  McMillan,  1910 
Arnold:     School  and  Class  Management.  McMillan,  1910. 
Bagley:     Class  Management.     McMillan,  1909. 
Ragley:     Craftsmanship  in  Teaching.     McMillan,  1911. 
Bagley:     School  Discipline.     McMillan,  1914. 
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G.  H.  Betts:     The  Recitation 

John  Dewey:     The  School  and  Society.     The  University  of  Chicago 
Press,  1900.     Revised  Edition,  1915. 

W.  F.  Charters:     A  Brief  Course  in  the  Teaching  Process. 

S.  T.  Dutton:     School  Management.  Scribners'  Sons.  1904. 

Lida  B.  Earhart:  Types  of  Teaching.  Houghton  Mifflin.  1915. 

C.  A.  and  F.  M.  McMurry:     The  Method  of  the  Recitation. 

Moorehouse:    The  Discipline  of  the  School.  1914. 

O'Shea:     Everyday  Problems  in  Teaching.  Bobbs-Merrill  Co.,  1913. 

Strayer:     A  Brief  Course  in  the  Teaching  Process. 

Taylor:     Class  Management.  1903. 

Thorndike:     The  Principles  of  Teaching.  1906. 

The  following  persons  participated  in  the  Conference 
and  discussion  which  resulted  in  the  selection  of  the  ten  items 
of  the  rating-form,   substantially  as  formulated  on  the  rating 
sheets  and  used  throughout  the  investigation: 

Professor  F.  C.  Bagley,  Director,  School  of  Education,  University 
of  Illinois. 

Professor  L.  D.  Coffraan,  Dean,  College  of  Education,  University 
of  Minnesota. 

Professor  C.  K.  Johnston,  Professor  of  Secondary  Education,  Uni- 
versity of  Illinois. 

Professor  G.  M.  Whipple,  Professor  of  Education,  University  of 
Illinois. 

W.  S.  Miller,  Margaret  Cobb,  and  J.  H.  Hanger,  Assistants  in  Edu- 
cation, University  of  Illinois. 

Dr.  H.  0.  Rugg,  Instructor  in  Education,  University  of  Chicago. 

Dr.  C.  E.  Holly,  Assistant  Professor  of  Education,  Ohio  Wesleyan 
University. 
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Siraeon  Eole,  Student  in  Education  and  Associate  in  Horticulture, 
University  of  Illinois. 

Helen  Clarke,  Fellow  in  Psychology,  University  of  Illinois. 

A.  J.  Featty,  S.  D.  Huddelston,  Marlee  Lee  and  H.  D.  TerKeurst, 

graduate  students  in  Education,  University  of  Illinois. 

Geo. .A.  Brown,  Manager,  School  and  Home  Education. 

Principal  Flanninghara,  Urbana  High  School. 

Superintendent  A.  P.  Johnston,  Urbana  Schools. 
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APPENDIX 

Edward  C.  Elliott:    Tentative  Scheme  for  the  Measurement  of  Teach- 
ing Efficiency. 


Suggested 

INDIVIDUAL  EFFICIENCY  —  800  points  values 


I.     PHYSICAL  EFFICIENCY  —  80  points  (80) 

1.  Impressions  -  general   10 

3.  Health  -  general   20 

3.  Voice   20 

4.  Habits  -  personal   10 

5.  Energy  and  endurance;  power  of 

relaxation   20 

II.     MORAL  -  NATIVE  EFFICIENCY  —  100  points  (100) 

1.  Self  control   30 

2.  Optimism  -  enthusiasm   30 

3.  Sympathy  -  tact   20 

4.  Industry  -  sense  of  responsibility.  10 

5.  Adaptability   10 

6.  Sense  of  humor.   10 

7.  Judicial  mindedness   10 

III.     ADMINISTRATIVE  EFFICIENCY  —  80  points  (80) 

1.  Initiative;  resourcefulness   30 

3.  Promptness  and  accuracy   30 

3.  Executive  capacity   30 

4.  Economy  (time,  property)   10 

5.  Co-operation  (associates  and 

superiors)   10 

IV.     DYNAMIC  EFFICIENCY  —  100  points  (160) 

1.  Preparation.   30 


Including; 

a.  Intellectual  capacity 

b.  Academic  education 

c.  Professional  training 

d.  Command  and  use  of  English 

2.  Professional  attitudes  and  interest  10 

3.  Human  nature  attitudes  and  interest 


(Appreciation  of  values  -  physi- 
cal, intellectual,  social  and 

moral,  in  child  life)   10 

4.  Instructional  skill   80 

Including; 

a.  Definiteness  of  aim 
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b.  Attention  and  interest  of 

pupils 

c.  Formality  vs.  vitality  of 

instruction 

d.  Motor  vs.  verbal  methods 

e.  Application  of  the  tech- 

nique of  teaching;  organi- 
zation and  presentation  of 
subject  matter;  the  recita- 
tion as  an  artistic  product 

f.  Application  of  the  technique 

of  living;  participation  and 
contribution  of  pupils;  the 
recitation  as  a  democratic 
activity 

g.  The  tools  and  machinery  of 

inetruction;  effective 
adaptation 

h.  Assignment  of  work 


5.  Governmental  and  directive  skill   40 

(discipline) 

V.     PFOJECTED  EFFICIENCY  —  50  points  ($0) 

1.  Continuing  preparation   20 

a.  Daily;  b.  Weekly;  c.  Annual 

3.  The  school  program   10 

3.  Increase  of  professional  equipment 
(professional  association,  study 
and  reading;  travel)   30 

VI.     ACHIEVED  EFFICIENCY  —  350  points  (350) 

1.  Respect  of  pupils  and  community   30 

3.  Leadership;  stimulation  of  individuals 

and  community   60 

3.  School  achievement 

a.  Illustrative  results   80 

b.  Examinations;  rate  and  amount  of 

progress  of  pupils   80 

VII.     SOCIAL  EFFICIENCY  —  80  points  (80) 

1.  Intra-mural  interests   20 

3.  Extra-mural  interests 

a.  Cultural  and  ethical   20 

b.  Civic   20 

c.  School  -  patrons   30 


Total  Individual  Efficiency  800 
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Suggested 


DIRECTIVE  EFFICIENCY  —  200  points  values 


I.     SUPERVISORY  EFFICIENCY  —  2^0  points  (200) 

3..  Constructive  criticism   40 

3.  Non-interfering  supervision   40 

3.  Community  encouragement   40 

4.  Professional  confidence   40 

5.  Recognition  of  individuality   40 

Total  Directive  Efficiency   200 
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THE  BOYCE  SCALE  FOP  RATING  TEACHERS. 


I.  PERSONAL 

EQUIPMENT  — 


II.   SOCIAL  AND 

PROFESSIONAL 
EQUIPMENT  - 


1.  General  appearance 

2.  Health 

3.  Voice 

4.  Intellectual  capacity 

5.  Initiative  and  self-reliance 

6.  Adaptability  and  resourcefulness 

7.  Accuracy 

8.  Industry 

9.  Enthusiasm  and  optimism 

10.  Integrity  and  sincerity 

11.  Self-control 
13.  Promptness 

13.  Tact 

14.  Sense  of  justice 


15.  Academic  preparation 

16.  Professional  preparation 

17.  Grasp  of  subject-matter 

18.  Understanding  of  children 

19.  Interest  in  the  life  of  the  school 

30.  Interest  in  the  life  of  the  com- 

munity 

31.  Ability  to  meet  and  interest  pat- 

rons 

23.   Interest  in  lives  of  pupils 
23.   Co-operation  and  loyalty 
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(Cont. )  84.  Professional  interest  and  growth 

II.  SOCIAL  AND 

PROFESSIONAL  25 •   Daily  preparation 

EQUIPMENT   „ 

26.  Use  of  English 


III.  SCHOOL 

MANAGEMENT  - 


IV.  TECHNIQUE 

OF  TEACHING 


V.     RESULTS  — 


27.  Care  of  light,  heat  and  ventilation 

28.  Neatness  of  room 

29.  Care  of  routine 

30.  Discipline  (governing  skill) 

31.  Definiteness  and  clearness  of  aim 

32.  Skill  in  habit  formation 

33.  Skill  in  stimulating  thought 

34.  Skill  in  teaching  how  to  study 

35.  Skill  in  questioning 

36.  Choice  of  subject-matter 

37.  Organization  of  subject-matter 

38.  Skill  and  care  in  assignment 

39.  Skill  in  motivating  work 

40.  Attention  to  individual  needs 


41.  Attention  and  response  of  the  cl&ss 

42.  Growth  of  pupils  in  subject-matter 

43.  General  development  of  pupils 

44.  Stimulation  of  community 

45.  Moral  influence 
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E.  C.  Witham: 


I.  Morals 


Measuring  Scale  for  Teacher  Measurement1 

(  +  Uplifting  influence  in  others 
(  a  Upright  but  not  influential 
f  -  Questionable  character 


2.  Leadership     (  +  Among  students  and  in  community 

(  a  Among  students  only 
(  -  Lacking 

(  +  Magnetic 

3.  Personality  (  a  Not  magnetic  but  able  to  command  respect 

(  -  Too  quiet  or  too  talkative 

4.  Personal        (  +  Commanding.  Well  dressed 

Appearance  r  a  Clean  -  not  very  good  taste 
f  -  Untidy,  undignified 


5.  Ideals 


(  +  Of  an  idealistic  temperament 
(  a  Narrow 
(  -  Lacking 


6.  Education 


(  +  College  education 
(  a  High  School 
(  -  Grammar  school 


7.  Travel 


(  +  Over  1000  miles  from  place  of  birth 
(  a  500  to  1000  miles  from  place  of  birth 
(  -  Less  than  500  miles  from  place  of  birth 


lOnly  seven  of  the  forty-six  items  of  the  Witham  scale  are  in- 
cluded here.     The  others  are  omitted  on  account  of  space. 
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The  writer  graduated  from  the  University  of  North  Caro- 
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versity of  Illinois,  1914-1916,  and  a  Fellow  in  Education,  1915-1916 
His  three  years  of  experience  in  school  work  have  been  distributed 
as  follows:    Principal  Pine  Mountain  School,  (Durham,  N.C.)  1910- 
1911;  Principal  Haw  Fields  High  School,  (Mebane,  N.C. )  1912-1914. 
Aside  from  numerous  book  reviews,  he  has  published  during  the  past 
year  the  following:    State  Conditions  for  High  School  Work.  Edu- 
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